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THE CONDITIONS OP BELIEF IN ADVERTISING 


A. T. ForFfiNB^Gsu 
Columbia University 


A reader of the literature dealing with the Psychology of Ad¬ 
vertising finds numerous articles written upon the effectiveness 
of various mechanical devices, the attention and memory value 
of size of space and the position on the page, the influence of 
color, style of type and its arrangement, the effectiveness of 
repeating the advertisement, etc. The problem of arousing the 
(Sonfidencfl of the consumer in the article advertised, the condi¬ 
tions on whicli it depends, how belief in ndvertisements may be 
created and how it may be measured have been very lightly 
touched in experimental studies. The importance of these mat¬ 
ters is emphasized in every textbook on advertising. The fact 
that the American people are each year induced to squander 
many millions of dollars in worthless securities through the 
medium of advertising in some form, and that warnings seem 
quite ineffective in protecting them, makes one curious about the 
basis of belief in advertising. It is not enough to say that the 
American people like to be fooled and that there is no scheme 
too wild to arouse the confidence of a large proportion of them. 
The advertiser should know that action is dependent upon belief 
and that belief in advertising depends upon conditions, some of 
which at least are under his control. 

Belief is indeed a complex mental state and it may depend at 
any time upon a great variety of factors, the moat common of 
which are listed in textbooks of psychology and advertising. It 
is nob the purpose of this report to repeat such lists but to cite 
gome experimental lividence from the field of advertising to show 
the importance of a few of the conditions of belief for success in 
advertising. 

1. Belief ia rarely the result of reasoning. One does not go 
through tliD processes of logic to establish his beliefs. If logic is 
used at all it is to justify a belief already established. A atrik- 
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ing illustration of the separation of reasoning and belief is fouiul 
in the case of the insane patient who firmly believed himself to 
be the son of a king, and yet whose reason was intnet enough to 
enable him to solve complicated mathematical pi'oblems. 

The advertising of the New Gillette raw»r offered n good oppor¬ 
tunity for studying the relation between belief and reasoning.' On 
May IG, 1921, the Gillette Razoi* Company nnnnuncod "a new 
triumph of American inventive ficniua oE startling iiiLejc.sL to 
^very man with a beard to shave." The advcrtisomcnlH state 
that the "fulcrum shoulder, overhanging cap and cliniinck'd 
guard” were the three innovations which made ]Jos.sjble "for the 
first time in any razor, micrometric control of bliule position." A 
diagram showed "how the blade is biflexed between overhirngiug 
cap and fulcrum shoulder. It is flexed once into the inside curve 
of the cnp. This is the minor flexure—the curve for easy gliding 
action and play of the wrist in shaving. It is flexed a second 
time—more sharply and in a shortei* rndhis—by ilie grip of the 
overhanging cap the whole length of the fulcrum shoulder. Thi.s 
is the major flexure." This arrangement provided an oxnctne.sa 
of adjustment to 1-1000 of an inch. Advertisements eontnining 
tliG above information and well illustrated were given to lllLy- 
seven men, college students and uiiiversity graduates, together 
with a series of seven questions intended to test both their belief 
in the new razor and their understanding of it. The unawevs to 
these questions showed that all the students agreed that tlic new 
razor was better than the old one, and that they would rnthci: pay 
for the new one than $1.00 or $2.00 for the old one. In 
supporting their belief they were allowed to consult LUc udvcrtiKC- 
ment as much as they wished. They quoted the "fulcrum .shoulder, 
overhanging cap and channeled guard," which inade pos.sible 
“micrometric control of blade positaon," hut not one of them could 
explain how the micrometric control was obtained or wlmt ad¬ 
vantage there would be in having such micrometric control. They 
believed that the “channel guai’d" was an improvement ultliough 
they Could not tell why it was an improvemejit. As to the import¬ 
ance ,of major and rninor flexui’es they were entirely ignorant. 
Five minutes examination of an enlarged diagram of the now razor 
improved their understanding of the razor* little or not at all. 
Here is a belief effective for the purpose of the advertiser in 
spite of the inability of the reader to support his belief with 
reason. This experiment is quoted not to show that the adver¬ 
tisement is poor, but merely to show that in advertising reason- 


‘Tlic Btinly about to be dcatrlbed Is p.-irL oC n Ifirgor liivundtruiloii .mui- 
lluc^^rtatc^ ^oia^tejQ nnd Uie writer, wjjlch wlU bo n-iioi-tcd ill a 
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ing is noL needed fco crente belief. Whether the space in the ad¬ 
vertisement devoted to argument might have been more profitably 
filled, is however an interesting question. 

2. It is not necessarily that which is true that is believed. 
The fact that a statement in an advertisement is true will not 
BUiwnntec belief on the part of the readers of it. The truth may 
be too startling and surprising to be believed, and in some cases it 
might be more oiTecLivo to tell half the truth than the whole truth. 
Tliree advertiseinenta were chosen for investigation in this con¬ 
nection, each of thorn presenting rather unusual information. In 
each cjuse the truth of the statements made was vouched for by 
reTiable individual."?. Each of the advcrtisoinents was present.;d 
to 100 people, together with a scries of statements about them. 
The individuals wore to simply check those statements that most 
nearly represented their opinion about the advertisements. The 
statements were carefully prepared so as to avoid suggestion. The 
studies of the three advertisements will be reported separately: 

Taijlor Trunk AdveHiscnient. This advertisement showed the 
IjlioLograph of a huge elephant standing on u trunk. The picture 
was accompanied by a signed statement as to the genuineness of 
the photograph, and by statements to the effect that the trunk 
was taken from the regular stock. Statistical treatment of the 
replies of the persons tested showed that 38 percent of them 
doubted the truth of the statements made in the advertisement; 
2‘1 per cent qucslioned the genuineness of tlie photograph; and 
21 percent believed that it would be impossible to construct a 
tvupk strong enougVi to withstand sneh a weight. That is, in Irofn 
one-fifth to Lwo-fifths of the persons tested the ndvertisoment cre¬ 
ated a .state of mind adverse to the purchase of the article. 

Stanley Vacuum liottlo Advertisement. This advertisement rep¬ 
resented a vacuum bottle falling from a high window, and de¬ 
scribed an incident in which a Stanley bottle had accidentally 
fallen from an eighth story window and suffered only a dent, 
which did not at all interfere with its usefulness. The replies to 
the questiorns submitted with this advertisement .showwl that 31 
percent doubtc<l the truth of the statemcnla, while 22 percent 
refused to believe that n vacuum bottle sufficiently strong to sur¬ 
vive the fall could po.ssibly be constructed. 

Edison Phonoyraph Advertisement. This advertisement pic¬ 
tured one of Uie well known “tone tests” demonstrations in Car¬ 
negie Hall, Pittsburg. II showed the stage occupied by a well 
known singer and an Edison phonograph, with the audience in the 
background. On the advertisement there wore reproduced a 
mnnbor of cli])ping.s from the daily papers describing the remarlc- 
able denionstralion, each clipping making the statement in one 
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form or another that no one in the audience of 2,COO people could 
distinguish between the voice of the aingev nml its vcpvoduction. 
Replies from 100 people to eight questions about this nclvertise- 
ment moy be summed up aa follows: 77 percent doubltnl the 
truth of the statements contained in the advertisements. per¬ 
cent believed that they could tell the dmcrence between a real 
voice and its reproduction by any phonoffrapli. iiercent be¬ 

lieved that mechanical sounds would betray tlie plioiiograph in 
these “tone testa." 49 percent believed that some form of Ivickevy 
or deception was practiced. 60 percent believed tIuiL Lhn JU'Li.sL 
intentionally imitnlod the phonograph. 44 percent believed that 
a apecially constructed phonograph was used for the cleinaUKtru- 
tion rather than a stock instrument. OB percent believed Lhal no 
phonograph could successfully undergo aiich a test. 99 percent 
stated that an actual demonstrotion of the "tone tost" such ns 
that described in the advertisement would not convince them of 
their inability to distinguish between the human voice ami it.'i 
reproduction. 

This advertisement seoraed especially effective in failing to cronto 
belief in the minds of its readers, when over three-fourtlis of 
them doubted the truth of the stotenwnts. The writer recom¬ 
mended in this case a less extreme and leas startling form of 
appeal which should not arouse the antagonism mimilcslcd in this 
experiment, 

Thus far the negative side of the question lins been presented. 
If belief in an advertisement does not depend upon the U'uth of 
the statements made and does not depend upon the reasoning of 
the reader, on. what does it depend? To state the inntter simply, 
We may say that ideas which are present in the mind and are not 
interfered with by any opposing ideas will be believed. This is 
merely a bare statement of the law of suggestion and to comply 
with it in advertising, conflicting ideas should be prevented from 
entering the mind. There are many conditions on which such un¬ 
disturbed acceptance of ideas depends, Only three will be men¬ 
tioned here. 

1, The ideas nronaed by an advertisement must not conflict too 
sharply with the render’s experience. Inti’ospcctiona voluntecrod 
by many of the 100 subjects who served in the experiments just 
described indicated that their past experiences with trunlcs, va¬ 
cuum bottles and phonographs furnished conflicting ideas whicli 
the advertisements were not sufflciently powerful to overcomo. 
This was especially true in the case of the phonograph advevtiae- 
ment where doubt was expressed in n largo percentage of the 
cases, 

A.n experimental study of an advertising campaign that fuilod 
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showed cleorly the need for complying with the conditions of 
belief. "Radior Products,” a scries of toilet prepai'fttions were 
introduced into this country by an English firm. The appeal 
contained in the advertising may be illustrated by tlie following 
quotation taken from one of the advertisements; "Radior is the 
magic new word in the book of beauty. It means the triumphant 
union of the finest complexion preparations with actual radium. 
Its content of radium works the miracle of nature. It purifies 
the akin, givea it the health to regain ita youthfuhAeaa and loveli¬ 
ness." The container of these preparations was represented as 
emanating rays which were very suggestive of bolts of lightning. 
These toilet preparations could not be sold—the campaign had 
failed. Why? One possible reason for the failure was that the 
suggestion to apply radium on the skin for toilet purposes con¬ 
flicted too sharply with people’s opinions about radium. In order 
to discover what people believed about radium, u questionairo was 
carefully prepared in the form of a True-False test and submitted 
to 400 people, comprising a well-to-do, well-educated group, a 
group of average intelligence and financial standing and a special 
group of person.s working in “Beauty Parlors." The questionaire 
is reproduced below. It was constructed so ns to minimize the 
influence of suggestion and to correct for it when it did occur, as 
for instance in combining replies from question 2 and 7. Ques¬ 
tions 3, f5 and 10 were introduced as fillers nnd had no special 
significance. 

Road the first statement on this sheet. If you feel that it is 
true, underline the word "True,” If you feel that it is false, 
underline the word “False.” Then judge each of the other state¬ 
ments as true or false. If you do not know, guess at it. This 
sample statement is false and is marked as it should be: 


There are eight days in the week.True False 

1— Radium is a deadly poison...True False 

2— Radium is so costly that it cannot be 

used for commercial purposes. True False 

3— Treatments with radium will make 

the hair grow .True False 

4— Radium ia used in the treatment of 

such diseases as cancer...True False 

6— Radium is n substance which gives off light.True False 

C—Radium whdn applied in diluted form gives 

a healthful stimulation to the akin.True False 

7— Radium is now used in the manufacture 

of many products in common use.True False 

8— Radium causes burns when it comes into 

contact with the skin .True False 
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9 _Toilet preparations containing rndiuin nre to 

be recommended for their beneficial cfTccLs,... 
10—Certain forms of radium can be obtained 

at little cost ...... 

11 _Radium preparntions .should not bo ii.sed 

except on the advice of a physician. 

12—Radium products are gaining poi)iilai'iLy a.'i 

mild stimulants to hcr.lth and growth. 

Read the following question and iin.swer it by u 
or "No"; 


....True 

False 

....True 

False 

.True 

FuLse 

.True 

False 

ndi'i'lining 

"YeH" 


If you should be told that there was a toilet prciiuration of high 
quality and moderate jirice and -which contained a iniiuito f|ii:niLity 
of radium, would your knowledge of the eflects of v.ulinni he 
such as to make you want to buy it?.Yes No 


Nothing need be said here concerning the dlfi'ortrncc in the 
reactions of the different groups to the qucstioimu-e, oxeept that 
the most intelligent group had the stronge.st roaotion iigniiist 
radium-containing products, and that the "Beauty Parlor” ^vo^kor.s 
had the least antagonism, Inquiry among these people indicatod 
that some of them had confused radium with the violet ray wliieh 
was at the time a very popular form of treatment with them, Tlie 
results of the study of the que.stionaire may be Hunimarized ii.s 
follows; 

Forty-eight per cent of the persons te.sted believed that rndjuni 
is Q deadly poison; 80 per cent believed that it causes hums when 
it comes in contact with the skin; 89 per cent believed that railium 
preparations should be used only upon the advice of u physician; 
71 per cent said that they would not buy any kind of toilet prepa¬ 
ration that they knew contained even a minute quantity of radium; 
90 per cent thought of radium ns a substance used for the tveiil- 
ment of cancer. The whole experiment may be summed up in the 
statement that about 70 per cent of all the rcplieb inilicuted 
opinions unfavorable to radium-coiitaining products us toilet 
preparations. The basis of this unfavorable reaction could easily 
be traced to the people's accuinulated experiences of radium. 
Clippings of all articles dealing with radium and niipoariug in 
newspaper's and magazines were collected for a short period. 
Practically all of them emphasized the harmful eft’ect.s of radium 
and the dangers incurred in handling it, instead of any bcnetlciul 
properties it might possess. 

This is a clear case of the inability of an ndverLusing campaign 
to overcome the resistance established by oxperrehce. To crenlc u 
favorable attitude toward radium-containing products as toilet 
preparations by nn educational campaign conducted in news- 
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pEipera unti mivgnzinca might conceivably have been possible, But 
it coi'Laiiily would have been impracticable. 

The mass of experiences upon which beliefs rest is gradually 
accuiniilatiiig and being inodilied by additions. As some one has 
said, “Confuhmci! is at the .‘uimu time .stable and fragile." It is 
stiil)lo bocsui.su of the hullc of expcricnce.s on which it rests; it is 
frsigilu licciUi.se it i.s suhjoct to clmnge from new experiences. A 
.supposed ])jirgjiin which is found to bo not a bargain, a derogatory 
new.M^a)nn- report i\b(»ut a stove, a mi.sprint in the advertised price 
of an article; any one of tbo.se may be the experience tliat will 
introduce a conflicting idea into the mind of a consumer and upset 
tlio condiLimis Eavoralde for hi.s belief. The advertiser, appealing 
as he does to populations, cannot take account of the shiftiugs of 
individual e.xperienco 'uul belief, but he must Lake account of the 
wido.sin-uad and slowly accumulating experiences which may 
amount to powerful j)rcjudice.s again.st bis a])peal. 

2. Ideas that ai'c to create Ijelicf mu.st come from an auLborita- 
tivo source. This is a well-known law of suggestion. The 
hypiioti.'^t can do nothing wiLlioiiL Ijis air of authority and the 
subject';;. recognition of it. "We arc accustomed to believe the • 
stnLcmeuLj! made liy a pcr.son in whom we liavo confidence, and to 
believe what i.s priuLcd in a medium which we consider authorita¬ 
tive. Even if Lliere in conilict with one’.s own experience, he will 
.soinoLime.s accept Llie contrary experience of another jicrson as a 
bnsi.H for beliid' if he have .sufTirient eonlidente in the other person. 
But even tlieu Llic new ex|)ericncu may not bo Loo conflieting. 
Advovti.scr.s liave for years .striven to develop an aLmo.sphure of 
confidence and mitliority by all the devices at their command. 
The present experiment was intended to measure in n tentative 
fashion the degree of coiifidonce which an advertisement can create 
in compari.son with other fornus of imblication. I have compared 
tlie degree of belief or doubt avou.sed by the three advertisements 
previously doscvibecl (namely TuyUiv Trunks, Stanley Vacuum 
Bottles mid Edison Plionogvapli.s) witli the belief aroused by 
essentially the same staLoment.s coming from a reputable journal. 
In order Lo make sucli a compari.son, the facts stated in each 
advevtisetneuL were prepared in the foi’m of a news item abstracted 
from an engineering magazine. One .such abstract will illustrate 
the cliarucLer of all. Tlicse abstracts were presented to a group 
of 100 persons of Llio .same general character as those tested in 
tlie earlier oxiierimeut.s, hut who knew nothing of those experi¬ 
ments or nothing of the purpose of the present experiment. Along 
with the id)sLract of each adverLisemenL was a .scries of (lUCsLions 
n.s nearly as pos.silde like those used in the lest with the advertise¬ 
ments. As far a.s we were able to ascertain, no one doubted the 
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ftutheuticity of the news abstracts. Instead of reportinff the rc- 
suits of tKe three questionaircs in detail, it will be HufTicient to 
compere for each of the three cases the number of replies indicat-- 
ing doubt in the advertisement and doubt in the nows item. It 
must be remembered that the news item mentioned no ti ndo-nomed 
article nor indicated any connection with .specially udverliacd 
goods. 

The following is an extract from—-Mnffa/.inc of Juno, 

1921, Read it carefully and then nn.swer the quc.stions given be¬ 
low, by scratching out with a pencil the piu-t of each Lhnt does 
■not give your opinion. 

A Remahkable Shock REaiarmc Consthuction 

’‘A new type of wardrobe trunk was recently put through a 
remarkable test of strength. The five-ton elephant belonging to 
the New York Hippodrome was made to stand on the empty trunk. 
An exammation of the trunh following the test showed that it 
had withstood the great shock without damage. 

Interesting photographs were made of the test, showing the 
elephant mounting the trunk, seated upon il, and then stepping 
off of it.” 

1— I believe—doubt—do not believe—the statements matle in ti\c 
above extract. 

2— I feel that the photographs that portray the lest are—arc 
not—genuine, 

3— I do—do not—believe that a trunk could be made atvong 
enough to suceeasfully<undergo the test described- 

Percentage of replies expressing 

doubt In the Ada In the Iletos Itcina 

Taylor Trunks . 2B per cent 43 per cent 

Stanley Vacuum Bottles .27 per cent 43 per cent 

Edison Phonographs .55 per cent 40 per cent 

In two of the cases it will be noted that there was greater con¬ 
fidence in the advertisement than in the news clipping, while in 
the third there was greater confidence in the news clipping, Ai\ 
examination of the three advertisements did not ofFord an entirely 
satisfactory explanation for the shift of belief in the case of the 
third advertisement. It seems safe to conclude from those records 
that although belief in certain advertisements may be low, they 
may carry at least as much authority in presenting a set of facts 
as can be conveyed by a news article. The doubt in the coses wc 
have studied ia the effect rather of conflict of ideas with experi¬ 
ence, than the effect of the use of an unauthoritalivc medium of 
expression. Introspections volunteered by the subjects suggest that. 
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illustrations and especially photoeraphs Used in the advertise¬ 
ments tend to strengthen belief. Unless one suspects trickery, as 
some of our subjects did, looking at a picture ought to carry with 
it greater weight in establishing belief than merely reading 
printed matter. Even if Mark Twain was right in advising that 
one believe only half that he sees and nothing that he hears, the 
advantage in favor of the picture is obvious. 

3. There is a third important condition of belief, namely, that 
we tend to believe whnt arouses our desires, our fears and our 
emotions generally- I have no experimental evidence to offer in 
this connection, and know of none in the field of advertising. But 
evidence for the importance of this factor may be drawn from 
psychology. "Wm, James has said, "A man who has no belief in 
ghosts by daylight will temporarily believe in them when alone at 
midnight, he feels his blood curdle at a mysterious sound or vision, 
his heart thumping and his legs impelled to flee." In strong emo¬ 
tion WG might find the condition responsible for the belief in the 
bargain counter. The politician finds no difficulty in honestly be¬ 
lieving whnt best fits in with his aispirations, while hia opponent 
may as honestly believe the opposite and for a like reason. If 
one really wants n certain suit of clothes or an automobile which 
costs more than he should pay, he may honestly believe that he 
is making an economical purchase, Once a belief has been estab¬ 
lished in this way, logic and reasoning may be used to support it. 

These three conditions of belief which I have described repre¬ 
sent three important variables in the formula for advertising suc¬ 
cess. For most advertising situations they are unknown variables 
which may interact in a very complex manner. But they may be 
discovered by careful examination. That they are not always 
sought or discovered, is clear from the cases I have cited which 
were taken from advertising already used. Three questions might 
well be asked about every advertisement: (1) What adverse be¬ 
liefs and experiences does it have to meet in the minds of con¬ 
sumers? (2) Will the authority which it wears by its mode of 
presentation or by the medium in which it appears enable it to 
create belief? (3) Does the appeal used arouse desires which will 
in turn create belief in the advertised article? These arc human 
behavior questions that psychological methods will enable the ad¬ 
vertiser to answer before the advertising is used as well as after 
the money has been spent upon broadcasting it. 
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Prom the Paycholofe'ical Laboralory of Indiana Univuraity 
By H. D. Kitson, C. W. BarNes, and C, IUpi-kni.at’/ 


IX, Bight and Left Hand Parks in Mara/jnes 

A. considerable tunount of discussion hns ctnlJMcd jiround the 
question as to which is the more favorable position for ndvevtiae- 
menta in Tnngnzlnes, the right or left-hand page, The question 
has usually been approached through the InhornLory method, sub¬ 
jects viewing the momenlnrily exposed pages of n ‘Miunniy" or n 
veal magftgine and then va'iting down all they have seen in the 
onlev in which they have seen it. With this technic AvUuns' vc* 
ports a value of the right hand page which is to LlinL of tlie left us 
100 is to C5, That is, be estimates the right linnil to be fifty j)cr 
cent sijpci’ior. Hotchkiss and Pranken’ eatinmte from tlioir inves¬ 
tigation thftt the right-hand page of a magnninc'is worth five per 
cent more than the left-hand page. 

Tn Order to Secure nddifcloitnl light Upon the question the writers 
approached the problem with the historical tcchuic, .seeking to dis¬ 
cover the frequency with which advertisers actually usicd llui right- 
hand and left-hand pages. 

The materials used were 1082 conscciitivc pnges of advorLisiiiR 
matter in the American Magazine and 1000 in tlic' Sntui'dny Eve¬ 
ning Post, for the year 1922, Beginning with the first advortiso- 
ment following sclid reading matter tabulation was imulc o£ the 
successive pages contaimng advortiaing matter, exahisivo of covgv 
pages. Besults are shown in Table I, 


TABLE I. 


SIlOWlNi; THE PnEQfBKCl AWTII WHICH RIGHT AND I.RFT-IlANI)' 
I'AfJlOS CARRY AIH'KnTlSBJlBNTS IN I^JIE AMEIIK-’AN 
MAUA'AINE AND THE SATHROA'S EVENING 
I’OHT t’Ott 1 'j22 


Total Total Total 
Right Left Total 
No. % No. % 

Amer. ... 676 66 606 44 1062 

S. E. P. 621 62 481 48 lOOO 


Full Full Full 

Right Left Total 

No, % No, % No. 

SOI 82 64 18 365 

350 07 171 33 621 


lonf' v ' 100 AtlVQfUslBB ana Ita Meutnl I.aNVB, New Votk, MncmUlun, 

’G. D. Hoichltisa and R. 0. Frimkoj, AUontlon ViUins of A(lvertlni‘iinjiiLH„ 
Vt-Tk, New iCcirk t'nWerBiiy, itf2U, p. 21. 
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These figures show that in both magazines the right-hand page 
is used for advertisements more frequently than the left; in the 
American 66 per cent of the times and in the Saturday Evening 
Post 62 per cent of the times; with n frequency on the aver¬ 
age 17 per cent greater than that for the left-hand page. 

Still stronger evidence of the favor in which the riglit-hand’page 
is held conies from facts shown in a separate tabulation which 
was made concerning the location of full page advertisements, 
There were 306 of these in the American Magazine and B21 in 
the SaLuvdiiy Evening Post. Eighty-two per cent of the former 
and 07 per cent of the latter appeared on the right-hand page, In 
the first named periodical the right-hand page ivas used for full 
page ndvertisements five times ns frequently as the left, and in 
the Saturday Evening Post twice ns frequently. It was observed 
that cerUiin advortisers who consistently used the same relative 
po.silion in issue after issue ulmost invaviubly used the right-hand 
page. 

On the assumption of Llie historical method, that a practice 
much in vogue has probal)ly jirovcd it.self profitable, it would ap¬ 
pear from lhc.se result.s tliat the right-hand i)agc in magazines is 
more profitable Llian the left. True, the practice here revealed 
need not neces.siirily be con.sidercd as having been based upon 
conscious reckoning of conipuvative profits and losses from right 
and IcCt-lmnd insertions. Even at best it probably represents only 
the fruits of a “sul)-e()nscious'' "bunch.'’ Nevcrthelos.s it is com¬ 
ing to ho recognized that .such a proce.ss of summing up experience 
has some validity as a guide in business practice where scien¬ 
tifically valid niensiires are not yet obtainable. 

Appearance on the right or left-hand page of a magazine should, 
however, not be comudered as. wholly a result of the voluntary 
choice of the advorLi.s(‘r. RetiiiiremenLs of journalistic make-up 
would ineviUihly i)iit some adverLi.semenLs on the right and some 
on the left-hand page. Again, the requirements of color process 
or of some other technical matter might force certain adverti.se- 
meiits on one page rather than another. Moreover, some adver- 
tisevs do not specify either page, not regarding the matter as im¬ 
portant enough to bother with. For these reasons the more fre¬ 
quent use of the riglit-hand page can not be regaivled as purely a 
reflection of profitable experience. Still tliese factor.s alone might 
be expected to work tiiward an equal distribution of advertisements 
upon the right and lelT-haiid pages. The fact that they are un¬ 
equally disLvihuU'd indicates that some selective factor is at work 
in favor of the rigUt-haiul page. And tlic fact tliat this page i.s 
used will) overwhelming froiiuency by the pureha.sei'.s of the cx- 
pen.Hivc full page lulvertisemeiits iiulieiites tlmt the right-hund 



12 


KITSON—BARNES—lUPriiWbA'lT. 


pjige hna deinoBafcTaUd its superiority to ftt loa^it Bomo influential 
and successful advertisers. On slighter evidence Hum this space- 
sellers have set "preferred-poaition" prices. 


X. Position on Niiwsi’AinvK Pacii; 

In answer to the ciuestion, what is the boat portion of ii news- 
pnper page for an advertiaement, recommonclaLion.s liave been 
made as iollows'. the upper hnlf, the right-hnncl poutiou, upper 
left-hand corner, upper right-hBTid corner. Or, in recognition of 
the need for considering the right and left-hand pngen scpnvntcly, 
the statement hfls been made that the upper outside corner is 
preferable.* These conclusions have been renched chiefly from 
laboratory investigations in which the subjects hnve been shown 
a "dummy" or a real newspaper or magft7,ino contuiniug ndvev- 
tisements or -nonsense syllables distributed among the various por¬ 
tions of each page, and hnve been asked later to write down those 
items which they have remembered. The positloii.s of those itciiia 
mentioned the greatest numbers of tiiuea linvo been judged to be 
the most favorable. It should be noted that the conc]uHioii.s re¬ 
garding favorability of positions arc for the most part based upon 
studies made with magaainea. There is considevablc doubt 
whether conclusions reached regarding positions in magazines nre 
true also for newspapers. 

Regardless of the advuntageouaness of these particular positions 
on a newspaper page it may be seen from even a cursory exami¬ 
nation of the best type of newspaper that they aro not ciiually 
open to the use of advertising matter. For there is u jiracticc of 
newspaper make-up that crowds advertisements into certain por¬ 
tions of the page in order to reserve certain other portions for 
news. A circumstance which presents grave obstacles to the use 
of the positions which have been so laboriously designated as ad- 
yantageoug. 

Specifically described, the practice of newspaper make-up, tech¬ 
nically called "pyramiding,*' is to block up the advertisements first 
from the lower right-hand corner of the page. On some pages 
(usually the second page of the newspaper) only a small portion 
■of this corner Is used. But as an increasingly larger portion of 
the page (towards the middle and latter half of the paper) is 
consigned to advertisements the advertisements begin to run iip- 
■ward and leftward until often only a small portion of the upper 
left-hand corner is left for news. But this corner is usually thug 

’Adams, on. clt. D, 101, 

HotchktBB and Frankcn, op. clt. pp. 23 - 25 , 

Scott Foreaman and Co, loU, Clilca«Q, pp. 
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I’eserved (unless the entire page is devoted to advertisements). 
Here is an apparent block to eilectivc newspaper advertising, at 
least to that theoretically recommended by laboratory investig¬ 
ators. 

In order to measure this block and express it in quantitative 
terms the wi'itcra undertook ah investigation of actual journalistic 
practice. Choosing a newspaper that admittedly represents a high 
standard of journalistic make-up and advertising value, they tab¬ 
ulated the number of times the different quarters of pages were 
occupied by udvortiacments, and from this calculated the chances 
that tin advertiser might secure a “favored" place for his adver¬ 
tisement. 

The New York Times was used, and 1000 successive pages bear¬ 
ing advertisements and news were chosen from the issue of May, 
June and July, 1922. Those pages were omitted which contained 
nothing but advertisements, also those containing classified adver¬ 
tisements. Notation was made in each case as to whether or not 
the particiilur portion (half or quarter) contained any advertis¬ 
ing matter, be it ever so small. Results are shown in Table I, 
and Figure 1. 


TABLE L 


SIIOWINO TIIIl Nn.MUmi AND PKU CI-JNT Ot' Ul'l'IOn AND LOWDR. 
UUilIT ANII MOL'T POUTIOKS OP DEPT AND RIGHT HAND 
L’.VGGS (K.’(:Ut»IKD UV ADYKUTISEMENTS IN THE 
NEW VORK TIMES DIJUINO MAV. .TUNE 
AND JULY, 


00,T liCft lliinO PiiBPH 
Lovvur Unit Ulipur IIiiU 

I,eft lllKliL Li'CL UlRlil 

(h'lirli'r G>uirU>r ipiivrlvr Ounilec 

No, </o No. h’‘>. Vo No. % 

175 :iu« 77 ino ;jo a7o 73 


JKi Right lliinrt VngPH 
Lower Hall UDiiar Half 

Li-rt night Left Right 
Iluarler Quavlcr tjuiirter Quurter 
No. f/o N«. Vo % 'ON % 'OM 
115 23 335 (IB IJ-O 23 203 00 


Left hand page Right hand page 


30 

73 

23 

60 

35 1 

77 

23 1 

68 


Fig, 1. iSihJwing the per cent of pages on which the variou-s 
quiirLoi.H were occupied hy advertising matter. 
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1. Left and RigM-hand Pagas. 

Of the one thousand pages exnminotl, 605 were on tliu left-hand 
page and 496 on the right-hand page. (It is inleresting to note in 
this connection that fidl-page aiWcrtisemcnts, •whieh luid lieeix tub¬ 
ulated incidentolly but not counted nmoiiK the Ihoiisaiul .sliowii in 
the table, appeared move frequently on the right-binn! i)u;gL'. Of ii 
total of 235 full-page advertisements, 120 or fiS par cent were on 
the right-hand page,) 

2. Lower half. 

a. Left-hand page. On the 605 left-hand pnges Llio lower left 
quarter was occupied by advoitiscmcnts in 115 or Itn per cunt of 
the cases; the lower right quarter, in 300 or 77 per cent of the 
cases. 

b. Right-hand ptipe. On the 405 riglrt-hniul jiufics the lower 
left quarter was occupied by advertisements in Xl") ur 23 per cejit 
of the cases; the lower right quarter, in 336 or GB pur cent of the 
cases. 

3. Upper half. 

a. Left-hand page. On the 505 left-hand pages t!ie upper left 
quarter wos’occupied by advertisements in 115 or 2,'] ptir cent of 
the cases; the upper right quarter, in 295 or 00 per cunt of the 
cases, 

b. Right-ha-iid page. On the 495 right-hand pngc,*? the upper 
left quarter was occupied by advertisements in 155 or 23 per cent 
of the cases; the upper right quarter, in 295 or 00 pcir cent of 
the cases. 

CONCLUSIONS. 

These results show that regardless of the alleged superiovity of 
certain positions in newspapers, there arc pi'onouncod liinitaLion.s 
to the likelihood that these positions may be secured. Thus al¬ 
though the right-hand page may be more desirable, it will lie open 
for advertisers no more frequently than the left, sinco tlio-so re.sults 
show it to be occupied only 495 times in 1000. 

The upper outside quartei', w'hich is reconinicnded a.s being ino.st 
valuable of all can be secured only 30 times in 100 on the left-hand 
page, though,* fortunately it can be secured 60 times in 100 on the 
right-hand page. (For the sake of easier visualization, tlie fre¬ 
quency with which the various quarters of left and right-hand 
pages are used is shown diagi'amatically in Figure 1.) 

The right-hand side of both pages is twice and even three times 
as likely to carry advertisements as the left-hand side. Which 
means that in the case of the left-hand page the majority of ad¬ 
vertisements are going to be on the inside. And, unfortunnLely 
for the advertisers, this tendency is more marked in tho ca.se of 
•the left-hand page than in the case of tho right. Those amounts 
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may not hold good for all now.spnpora, especially for papers uaini? 
the pyramid system more thoroughly than the New York Times 
With such i-npors it is likely that the percentage of pages carrvinir 
advertisements in the upper left-hand corner would be still smaller 

From a journalistic point of view this quantitative investigation 
of the practice of jiyrnniiding shows that tlie pyramiding m-o 
grosses nuicli more rapidly upward limn leftward, the upper right 
portion of the page lieing occupied almost ns froqiicntlv as the 
lower right portion. Tlioiigh it sliould be remarked that the ad 
vcrtisenients did not u.siiiilly occupy the entire upper right nuar 
ter; tabulation wa.s made if an advertisement merely extended 
into the uvea. 

While this invefltigaLion furnishes no light concerning the rcla- 
tive vulue.s of the various.po.sitious on the new.spaper page it 
sliows Lliab there arc distinct limitations to the ease with which 
certain po.sitions can he secured, and it sliows, at least for one 
high-grada liowspaiicr, the size of the limitations in quantitative 
term.s. It al.so .suggests that the findings of laboratory studies re 
garding many other problems of advertising might profitably be 
checked up with ncLual eondition.H in order to show the practica¬ 
bility of Llieir niiplieatioii in concrete situation.s. 



AN experiment IN TESTING ENGINE LATHE 
APTITUDE^ 


By Everett P. Fatten 
University of Wisconsin. 


The inveetigation reported in this paper wns carried out in 
co-operation with the Shop Practice Deportment of the Collogo of 
Engineering, University of Wisconsin. It was able to profit ma¬ 
terially by Q preliminary investigation made along the aame lines 
in 1&21.- It was also favored by the fact that in the Shop Prac¬ 
tice Course there were many students turning ovit aupposecUy 
identical pieces of work on fairly aUnilar lathes. Thera was an 
added advantage in the fact that the men directing the work in 
the shop were university trained, and consequently were able to 
give such aid that the preliminary psyclwlogical analysis of the 
job was made more readily than would probably bo the case in 
industry. 

The particular type of work investigated was n course in ele¬ 
mentary lathe practice, This involved four hours of shop work 
every week and two hours of instruction every two weeks. The 
students, following a combination of oral and printed instructions 
together with blueprints, turned out five pieces on nii engine lathe 
during the semester. These were: a worm, n wonn-wlicol blank, a 
bevel-gear blank, a spiral-gear blank, and a planer bolt. The, first 
four were turned out of cast iron and the Inst from rod steel. 

The criterion of this investigation wos the nniomit of .skill de¬ 
veloped in one semester of instruction. More specifically, the 
criterion was the quality of lathe work produced by the students 
during the course. Instructors’ estimates arc notoriously unre¬ 
liable, as was found by the preliminary investigation and should 
never be used if an objective criterion can be obtained, Fortun¬ 
ately in this ca^e the pieces themselves could be mcnsurccl and n 
thoroughly objective criterion thus found in the accuracy with 
which these pieces correspond to the blueprint specificHtion.'?. Work¬ 
ing with great care Mr. Brecky of the Shop Practice Department 
took thirty-three micrometer measurements on the five piccea pro¬ 
duced by each man measuring the varioas important dimoiiaions 

tltc Psycliotoglcal IiaboTatory, University of WIhooiisIii. (inuofnl 
acknowledewcut U heveby maAe tjv rrof. Clark L. DLU'iirlnu'iit of 

I’sycliploBy. null to I’rof. \V, L. Uabacy, aircclqr o£ Slnchhu; ProC. 

Hull liaii supurvlaea tlw Invcstlentlon nnci glvcu imicli liplpfiil nltlclHiii, 
osiicclany In tlie prcparallon of tlic mauuscrlpt. Prof. Daliuej’ Iuin given 
liL'iirly co-operation and been ol great: aaslatniicc piirllciiliiiiy in nroi iiriiiH 
subiccta nad In peccccUng some at the teats, 

“Tills Invcatlgatlou was repottca la a iwUBtei'e tlicala by I). \V. NoImou. It 
Is on file III llto nbrary, I'nlversUy of Wlsconalu. 
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of thoatt Several tl\Q\iaa’iv;l very actMtate Teaditigs were 

thus obtained. In addition the general finish of each piece was 
scored on a percentage basis. 

The measurements obtained were reduced to percentage grades. 
The deviation of each measurenient from the dimension called for 
in the blueprint was lirsL found. A check distribution was then 
made for each of the thirty-three nioa3ui'ement.s each distribution 
containing the deviations of nil the men on that measurement- The 
niediun of each distribution was assigned the value of SB, the 
average grade given by the Sliop Practice Department. The in¬ 
tervals of the distribution between tJie inediiin and zero deviations 
were as.signed values between SB and 100 according to the size 
of the deviation- I'lio fourth check from the opposite end of tlie 
distribution was assigned the value of 70 which is hardly pa.saing 
on the school scale. Tlu! intervals of the distribution between this 
point and the median were assigned values between 70 and 85. 
The last three checks of the distribution wore given below 70 or 
failure. Thus the larger the deviation from the standard the 
.sinnller would be the percentnge grade. The mean of the grades 
for each individual piece was found and the average of the mean 
grade.s of Llic live pieces belonging to one man was computed in 
order to get his dual grade in lalbe working ability. Although 
this jirocess took weck.s of work the resulting criterion was very 
reliable. Indeed tin* largo coelTicient of total correlation (R) ob¬ 
tained Inter \va.s probably duo in no amnll degree to the care taken 
in obtaining the criterion. 

In proceeding to find tests which would measure lathe ability it 
was first found iioces.sary to analyze that ability ns far as possible. 
This was done by watching the men at work observing particu¬ 
larly wherein the good ones dilferccl from the poor ones. As a 
result of this nnalysl.s eight LesL.s wore selected. Some of these 
at first glance would seem to liavc little coiinectlon with lathe 
ability in general, but they wore included because they were thought 
to tost a consLil.iient fiu’tnr. In selecting the tests an especial elTort 
was made to get tests as dissimilar as po.ssible so that there would 
be little duidicntion, Tlio detailed analysis will be given with the 
disevussion of the various tests. 

(A) While studying the men at work it was noticed that the 
worker must be able l(» ostimiiLe two dimension .space and to co- 
orclinato the motions of bis two liand.s. lie must also be quick 
and sure of movenieiiL. In oivier to test those ahilities the "co-or- 
diiHiLitin inHcliinc” wa.s (l('vi.s(!<l.' 'I’hc apparaLu.s is .shown in Fig. 

iii'eil I'lir lou li n iiiiM'lilrn' (Irvi h.i ii liy |)r. Hull, \vli<> worki'cl (iiil 

IlN Ki'iii'riil iii'lii-’ll'li''' 'I'lic III iicl li ;il lll■l,(ll•. III I'liiiMi nicMiiii were worUi'il 
mil Jiy I’nif. Diilnii'V 11«' (il‘>i> (l''-rit:iii'il lunl iii.iilr a luimln’r of liiiiiroviaf 
iiioiIcIn, 
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1. It may be beat thought o£ aa a compound lathe '"ro.st" ntiaclicd 



to ft board. The netion of the machine dcpemU'd on two sci-cws 
plftced at right angles to each other. Turning the«i(> Hcrow.q bv 
means of small evanks caused a carriage to tnove in (luy clcairod 
direction ii3 a horizontnl plane. A long tracer arm was ra.stoiieil 
firmly to the carriage. Projecting down from the iui<l(lle of the 
arm was a small brass point. This touched the .‘iin'fai.’e of a hard 
rubber plate which was fastened to the board near the main part 
of the machine, limbedded in the plate .so that their lops were 
flush with the surface were six brass pegs ni-ranged in u three- 
inch hexagon. These pegs were connected by an olccLric wire so 
that when the tracer point touched one of them ii buy./.(*r sounded. 
The object of the test was to start on signal from a certain point 
and make the circuit of the six brass spots as quickly a.s poasiblo. 
The time taken to go around was measured by a stop-watch. A 
correlation of this with the criterion, gave a-,42a. This wa-s the 
largest and most valuable correlation obtolncd. 

(B) Another measure was taken of this test, that of distance 
traveled, The tracer arm extended out beyond the contact point 
and bad a pencil fastened to its extremity. This traced an exact 
record of the circular path on a piece of paper inserted for the 
purpose, A typical record is shown in Fig. 2. The distance 
traversed by this rather meandering line was mensured by a 
specially devised instrument. The frame supporting the works of 
an ordinary watch was filed so as to expose the genr wheel on the 
^huft of the small second hand. The hands of the watch renmined 
intact. The frame was so held in the hnnd of the meaaui’Gr that 
the teeth of tins gear could be run around the* pencil tracing, fol¬ 
lowing in. detail all its turns. The distance traversed by this wheel 
was shown by the hands of the watch and could be read oft’ at a 
glance. It will be aeon that the circular distance was inon.surecl in 
units of revolutions of the small hand. One minute (or one revolu¬ 
tion) was ec)ual in length to 29.5 millimeters. The correlnLioii of 
this measure with the criterion was +.192. This was rather suv- 
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prisin" since it nnunifc that the Rrcoter fchc distance, the better 
the gi-ncle on shop woi’k. However, it was included in the fmnl 
team of tests, 



(C) A third score wh« hIso seciirccl by the use of the co-ordi¬ 
nation uppiwntus described above. It was observed that the 
worker must friM|iienl[y cut a true surface in a diagonal direction 
U3ii\g his eye to gviule him. Accovdinffly the subject was rerjuived 
to run the trticcr tliagonnlly iicro.ss bctwce?i two of the most dis¬ 
tant pegs going as ijuickly ns possible. Here, as before, the time 
was taken with a stop-watch. The correlation of this measure 
with the criU>rioi\ gave -.llSfi. This wns large but since it was 
thougliL that it wmtid tluplicale the fir.sL inensure tnlccn, that of 
time on the cireuluv (listnnco, inensure C was discarded. 

(D) Tile ju-cond inea.HUri* of Ihe diagonal co-urdinnlion wius 
made ii\ deviiiLums from a straight line between the two pegs. If 

subject traced a .striiiglil line his record wouhl coincide with 
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the diagonal and there would be no deviation. Ilowovcr, if he 
wavered and made wrong movea, his record would doviate con¬ 
siderably from the straight line distance and would be poor in 
proportion to the amount of deviation. Thi.s deviation was nicns- 
ured by the area of surface included between the veciird tracing 
and the true diagonal as shown by « .straight line drawn between 
the points, This was measured by moans of n plunimotov- The 
correlation of this measure and the evitorion was -.fl.'i'l, Tliis was 
so small as to be worthless. If the instructiniiH had bcon to trace 
as straight a line as possible this might easily have, prnvc'a a val¬ 
uable test, It seems to have distinct possibilities. 

It will bo noted thcat the co-ordinntion te.st described /ibovo is n 
form of miniature test. It attempted as is usual in such eases to 
incorporate in a single test n.s mnny of the various olements neces¬ 
sary for success on the job and in as nearly the right proportions, 
as possible. Being a miniature it wns portable and easily hnndled. 
One delect of the test is that it is undoubtedly inlluuiiced by train¬ 
ing and thus is not a pure aptitude test, 

(E&F) Further analysis of the job showed the necea.sity for 
close co-ordination between hand and eye n.s well n.s for tjuickness 
and accuracy of movement. Accordingly the number cliockiuK test 
was introduced. This was. the standard 'Woodworth and Wells 
number checking test in which the subject was started on signal 
and told to cross out all groups of digits contnining both 4 and 7. 
He was given one minute. The correlation of the number of right 
groups checked with the criterion w'ns H-.05C. This wn.s Loo low 
to be of USE so was discarded from the final ten7n of te.sts. The 
number of groups wrongly checked'correlated -.035 ao it was also 
discarded. 

(G) It waa believed that the possession of mechnnierd ingen¬ 
uity would be important for success in lathe working so an elTort 
waa made to test for this quality. Accordingly an adaptation of 
Stenquist's lock assembly test was used. The lock was simple and 
inexpensive. It consisted of six parts which were: n rectangular 
lowe'r case or plate, a dog, a spring, a bolt, a screw and nn upper 
plate. The subject was shown a similar lock which was already 
assembled and told to put the parts of the other lock together 
like it. Although the lock seemed very simple, many had great 
difficulty in assembling it. Four failed entirely giving up after 
working from eleven to twenty-one minutes. Tbc correlation 
with the criterion was -.199. Although not very high (-.33 
was obtained last year) it had such q low corrointion with the 
other tests that it was kept in the final team as tapping a real 
constituent of the particular aptitude under consideration. 
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(11) Tho ability to follow i^rinU'il ilircL-Uons find bliicpi-ints 
is obviously a factor in learning luLhe work. To moasuve this 
ability mnl to gain knnwlcdgf! of Iho :ml)joei.’s cjiiofulnoHs ntid 
pfiiiiHlaking traits, liox-dircclioiis test was iiiLrotlnciid. Tliis 

(eid ia Hie well-known Hejily rnizzle box, coii.Misiting of n small 
Idnck c.'ibinet conlninitig a lock ineclmniam workeil by lliree levors 
at tlift top un<l left siilea of lUe box. The object of Lbe test is 
to opiMi Ibis (iaor. The iiece.ssfiry .steps in the proee.'fs were 
printed on a lai ge eai’cl bearing an exeellent diagram of the box. 
Tlii.s was lu'fore llie siiliject as be Worked. Tbi.s Lest proved 
even morn dilVienlt Hum tin? lock le.sl. Ten njen did not open the 
box at nil, some giving «p with the tirst faiUu-o. The conelatimi 
of the time with the criterion wa.s - .270. This wiis large enough 
to warrant its use in the linal team of tests. 

(f) 'I'lie number fff wnuig inove-i imido was aaioLlier measure 
lalton on this te.-^l. However, lliis num-siire nniloubtedly did not 
iiiLrndiicf! any lu'w eleineiiL because errors caused the sul)jecL to 
start over again and Hum invveaaml his Lime. In addition Lhti 
covrelutidu was low ( -.ilt!) si> tliis measure was elimimiLod. 

(J) In doing good lathe work a great deal depends on the 

.skill of tln^ opmator in taking accurate* ineasiireineiiLs. Aeconl- 
ingly the e.vlinder jfaiijriiig lest was itdro«lueed. A series of nine 
brass cylinderM wa.s very esirefnlly inadi; iiniler Prof, Dabney’.s 
clivei'timi. 'riiese mesnmved .'.»7b", .WyV'. .IHIO", .bib", .bbO", .'.tUO", 
.SSri", and .H7d". It will be seen tliat lliere were three giotip.s 
eiieh composed of three cylinder-n. I'hicli group or sei ies w;is grad¬ 
uated by a diirerent eoii.slaiil the same ccnislnril bein^’* u.sed 
tlirouglmiiL a single group. The litjest series ehtniged by steps 
of .DOb", the next by and the coarsest by. 111.)", 'I'be md)- 

jccL was vjiveu u six-inch macUinisL’s rule, and Ji pair of caliper.H 
an<l told to llnil the cylinders which nicjisurc .Pdl)" ami .HfiO" ms 
quickly as imssible. Tin* lime Ljikea to find Lin* two cylindcr.s 
conjitituled one nn'asiire. This correlaU'd -.127 Avith Lbo criterion 
and was too low to In* «*f v;ilin*. 

(K) Another .score on the cylinder tc.sl was the anioutiL the 
chosen cylinder dt*vialed in iiiea.snremciit from the tine asked for. 
Thus if the subject chose the .bJUl" cylimlcv in place of the .'Jdb" 
he was given a deviate score <«f .bdo. If lu* thought tile ,900" 
cylinder inemnired .HH.'i", lie .seftred .(Jla. The .sum of Lbe.si' errors 
gave his devintton score, a.s .(•.'id. Thij! incasiiri' correlated -.1!K) 
witli till! eritei'ioii. T’liis .seeiiieil stinieieiiLly higli lu lie of use but 
it was (inally deeided to cliininate lln- lest froiii tiie final team 
hi'Cau.se it was really a Irniles lest niea.Miriiig ac«[uireil skill riiLher 
than apliUide, 
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(L) An elTort was made to test ingenuity mid ren.snninp ability 
by the match-squarea test, though nt the outset there Hecined but 
a gambling chance of success. The mfttch-squares test consisted 
of seventeen inotchea glued to a boanl in sueli n wsiy ns to make 
six squares iu two banka of three each. Tlio subject was .shown 
these squares then given a mimeoprnplied sliceL o\\ wliicli short 
lines were drawn to repreaent the inatchoa in the sainn position 
as on the board, He was told to cro.s.s out five Llio iiboi't lines 
in such Q way that if they were removed thero woiilil be loft 
exactly threo whole squares and no lino.s left twur. The time 
was taken witli a stop-watch. Wlion through, the .subject was 
asked whether he had ever done this or n aimjlar pu/.r.lu boforc. 
The tact that many were already fnuiilinr with it together with 
the additional fact that twenty-two out of thy sixty subjects could 
not do it at all seems to have destroyed whnt little dinguostic value 
the test may have had. The correlation with the criterion was 
only -h.lG'l. This was too small uud also in the tlivection cou- 
tvskvy to ’jihat Viould have been ex^wictod fo the test was tU.scavdod. 

(M) In watching the men at work it setnned ]n-obublc that 
n keen sense of space relationship \vn.s uece.i.'^Jiry, jinrticuhirly 
In guiding the cutting tool to its place and in finding ccnlt’VH. Ac¬ 
cordingly the circle centering test was devised. A slioct uf paper 
bearing a number of mimeographed circles, (see Fig. H) wa..s put 
before the subject. He was given a pencil and asked to inidcu a 
dot in the center of each circle as quickly nsul uccurnlely po.s- 
fiible. The task was complicated somewhat by the overlapping 
of some of the circles. The time required to plnce thuHC doin wart 
taken by a stop-watch and constituted one niea.HUre, This corre¬ 
lated -.201 with the criterion and since It was quickly and ea.sily 
taken. Since the test was so cheap and portable it was kept 
in the final team of teste. 

(N) Another measure was taken from this test the errors in 
locating the centers. These deviations from the tvuu centers 
were measured translated into grades by a rather complicutod 
process and these grades averaged to get the finnl grndo for euch 
man. Since this measure was not used the process will not be 
disensaed further. The correlation with the criterion was fairly 
high (-.278) but was in a direction contrm’y to what was ex¬ 
pected. Apparently the good subjects sacrificed accuracy to speed, 
Portly because of this, and partly because of the labor in scoring, 
this test was not included in the final team. 

(O) It seemed reasonable to believe that iC n man were skillfvil 
in handling woodworking tools he would also Lend to be an adopt 
in using other kinds, such as are employed in lathe work, Fol- 
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lowing this line of reasoning the woadwoi'king test ‘ wns given. 
The subject was asked to saw a three-inch ;:quare fi-om a small 
board of definite size and shnpe, being given a Jiaw, a fU|Unre, a 
pencil and a special device for holding tlic wood .such as is in 
common use in manual training shops. He was tinn?d hy means 
of a stop-watch, This meo.surc had the sui'i)risingly low correla¬ 
tion of -.119 with the criterion, It was di,'icard(:(l. 

(P&Q) Two other measures woic tnkem from the wooflwork- 
ing test one in deviation in dimensions from the thrcM'-inch .square 
and the other in deviation.s from the true right Jingles. These 
latter measures were very dilTicult to make, recnnriiig horns of 
almost microscopic work with a vernier rule, a .square and n 
rule calibrated to one hundredths inch. The correlations in both 
cases were low, being -,095 and +.070 respectively. Doth meas¬ 
ures were discarded. It was a source of .some suvpri.se that the 
woodworking test did not have more dingnustic value. 

The instructions for each test were given according to an un¬ 
varying formula so that the results would bo ns coinparnble as 
possible. The tosts'were given in n quiet room in a dcilinite se¬ 
quence. "When the subject was admitted he went in regular suc¬ 
cession from one test to the next, showing a card containing his 
name and number to each tester. By such devices a con-stant 
stream of subjects was kept flowing smoothly through the testing 
room. In order to obtain useful results, it wa.s thought desirable 
to Use u minimum of sixty records. Consequently over seventy 
men were tested so as to allow for the lo.ss of ten tlirough de¬ 
fective records from various causes, 

A summary table of the correlations already givun i.s Jis fol¬ 
lows: 


TABLE I 


1 ' 

*(A) Criterion with co-ordination test, time -.423 

'"(B) Criterion with co-ordination test, distance -1-.192 

(C) Criterion with co-ordination test, diagonal Lime -,350 

(D) Criterion with co-ordination test, diagonal ilevintion -.034 

(E) Criterion with number checking, rights +.05r) 

(E) Criterion with number checkig, wrongs —,035 

*(G) Criterion with lock test, time -.199 

*(H) Criterion with box test, time -.270 

( I) Criterion with box test, errors -.112 

( J) Criterion with cylinder gauging, time -.127 

(K) Criterion with cylinder gauging, deviations -.190 


"Dio woodAvorklnc tost was doviHcd liv Me 
i'BycUoloey UopnrtJiioni, Untvorslty or ^VlHcbiiH.n 


tl. MuL'llor lit llu- 
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TABLE I—cont. 


(L) Criterion witli mutch squnrc, time -I-.1G4 

^(M) Criterion with circle centering, time -,20l 

(N) Criterion with circle centering, grades -.273 

(O) Criterion with woodworking, time -,119 

(P) Criterion with woodworking, deviotiona in dimenHions -.095 

(Q) Criterion witli woodworking, deviations in angles +.076 

The varinblcH finally used wore renumbered for convenience; 
Criterion =1 

Co-ordination, distance —2 

Co-ordinntion, Lime --=3 

Lock test, time =<1 

Box te.st, time =j 

Circle centering, time =6 


The menn.s and standard deviations of these variables are shown 


in Table II. 

Moans. 

TABLE II. 

Slandanl Deviations. Unit of jlfca3?ireine»h 

M,-S4.04G 

S.D.,=3.080 

Percentage grade on work pieces 

M.,= G.OdOG 

H.n.r-- .2053 

Minutcs-diatance** 

M,= .0250 

S.I).,= .3809 

Minutes 

M.r- 5,8585 

S,l')„--5.080 

Minutes 

M,== 4.78 

.S.I>.;=2.G27 

Minutes 

M.= .3705 

S.I).,-- .2047 

Minutes 


The zero order correlaLiun.i and intcrcorrchition.'j nre shown In 


Table III. 


TABLE in. 



rn=-|-.192 

r.,- -,423 

rn= -.229 




v,i= -.199 

r..-=-t-,M2 

r„=+.050 



r.o= -,270 

!■:. = + .118 

l•■.,=+.036 r,5= 

-1-.103 


r,c= -.201 

r..<,=+.022 

iv.=-|-.170 r«= 

-.032 

r„=+.0:9 

The P. E 

. of each of 

the coiTc'.ations 

in the 

first column is 


roughly ,08. 

It will be noted that although the correlations with tlic criterion 
are fnirly high, the intercorrelations are exceptionally low. Move 
than usual strc.s.s was laid on the latter in this investigation be¬ 
cause it was thought that this principle is generally observed too 
little. To get the undiluted correlations with the influence of the 
oLlier tests removed, the zero order correlations were subjected to 

I III' IcHtit wliirli w«>r«> liii'Siiili'd In lUo llniil Lciiin. Tlic almvi' r’n 
wcri' all iiriiiliii'i-iiiiitm-iil rni-Mli-U'iilH 

111 lermii or clrcunircrcncL* cf Rcnra on second hand. 
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partial correlation, using Yule's formuln* nni\ HoHJinow’H' Bcnernil 
technique. 


t r ?cr 
12 13 23 ■ 



There were some fifty-two of Ihesc puvtinb. Only tliesu of 
highest order nvc given in Ttililc IV: 

TABLE IV 
Partial conelaLions 

i' 

1'2,313*1^ 
r 

U,23ri0=: _.'211 
ir).'2;n«= _.‘2.T» 
i«.2ai5« _.im 

Thene partial coi'velations show hut very little shrinkage and 
shew that the experiment was iinusuftlly succcMsful securing a set 
of tests highly uncorrelated with each other. 

After the partial correlations wove found, the cnelTicirut of total 
correlation was computod. This correlutiou of the criterion witli 
all the tests weighted in the best i)o.s.sible manlier, wn.s computed 
in two ways to check the arithmetic.® The formulae were 


E^= 


V 


2 2 2 2 2 
1- (l.r ) (Uv ) (l-r 1 (l-i- ) <Ur ) 

12 13.2 14 ,la 1 G .231 IC, 234 B 


I !1 2 2 2 2 

R= / 1- (l-r 1 (l-r ) (l-r ) (l-r , ) (l-r )' 

yj 10 IE,6 14,EG 13.450 12.34C6 

One correlation was .B54t) and the other .5545 showing lUl the 
partittls to be correct. This correlation is about as large ns seems 
possible to secure from such highly selected groups as university 
students. It demonstrates the pogsibility of detecting aptitude in 
quality of lathe work produced. 

In'order to get the maximum yield fi'om n team of tests ns 
well ns to use a set of test scores to predict probable succcfla in 
a given vocation, a regression equation must bo obtained, Tlie 

•I'lilc, liitioilucUou lo lliu TIu’ory oC ScaUtfllcH. ii, U'.IU 

“Ilosniiow, AiialyKlK uf McaUil L'mictUm, \\. 

'Roaiiiioa', uu. cfi„ u, <0, 
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gcncrnl form' for this c({unlion for six vnriobles (criterion and 
five Lcsts) ia: 

.s» so 

l.Sa466 i.234RC 

v r -* r _X 

1-- ti:..H66 ■ -iH- 13.2460 3 

Sl> SD 

C.ia4&6 a,124CC 


Sl> 


I.234CG 


SI) 


■\T 


1.23-lSG 


14.2360 

.m> 


4-1 16.2346 


4.12366 


SI) 


6.12346 


SI) 

1.23460 

--* 

16.2346 0 

SI) 

6.12346 

Whore Xi™ tho doviatioii of any subject from the menti of that 
vni'loblo (hero Uic crilovion), where x„ x,, x., x», and x, cc)unl the- 
dcvinlion of any aubjcct from the means of the roapectivc vnrin- 
blcs, and whore S.I). i.tHti, etc., ’equal the partial standard devia¬ 
tions. The.^e [ini tial standard deviations arc obtained by a formula 
of tho type:' 


s.n, -H.n, r .r • r—— r \ 
1.23450 1 V' l-r l.r V ’t 

12 13.2 14.23 

15.234 1G.234C 

The purliiil Hlandurcl deviations arc shown in Table V: 



TABLE 

V. 


S.D„. 

n.»=3.070 

S.D., 


H-U., 

.2’IH 

S.D„ 

..„.«=2.483 

S.D., 

.343 

S.D., 

i.mn= i2'i7 


Subatitutinn thc.su, tOKelher with the partial correlation coofti- 
cient, in the forimilu for the rGRression equation and solving we 
have: 

x.=2,:h)7x,-3,2r)ax,-.lH2x,-.;i53xs-1.99Cx* 

Tlti.'i, however, is not a very convonicnc form of the ro^rossion 
equation lor jiraeticul use. Substitutions were accordingly made 

'Viilc, (111 I'U,. I'. 211. 

'Yuli', 'Ml, I'll,, IP, 2;!7. 
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for the small x’s eo that instead of deviations from nionns were 
had individual scores minus the mean of that variable 
The formula then becomes: 

XrMU2.3S7(X.-M0«2(X.-M.)-.132(X..M.)-..')MfX.^M0 

-1.996 (X.-M.) 


Substituting values for the various means ^found in Table III) 
find solving, the following equation vma aecured: 

X,= 73 .G 35 + 2 . 397 X,- 3 . 252 X.-.iaaX 4 -. 3 B 3 Xi- 1 . 097 X. 

It will be noted that the values Xi to X. represent gross scores 
of any given subject on the preaent team of Ic.sLs while Xi repre¬ 
sents his probable grade in a course such ns previously described. 
Now if n person of unknown aptitude in this kind of work should 
be given the above tests, his test scores might be substituted in 
the above equation and his most probable grade in auch a course 
be predicted with some precision. To take an actual case, subject 
number 9 made in this team of teats, the fallowing scores; 

Co-ordinntion, dislauce^G.G revolutioris 
Co-ordination, time=1.05 minutes 
Lock test=:1.17 minutes 
Box tesb^S.S? minutes 
Circle centering, tirac:=;.33 minutes 

Substituting these in the equation, Ihc result i.s: 

X-73.636:=2.397(6.6)-3.262(1.0G)-.132(1.17)-l.f)i)C(.3r)) 

Solving, Xi=84.008, This man aetunlly scored fid in his five 
pieces. 

To lighten the work of prediction, both for this invesLigiition 
and for the one to be carried on with a new group of .subjects 
here next semester, a chart was prepared contiiining nil tlm 
products of the probable test scores nnd their respective weights. 
'Ihe scoL’es were then predicted for all the sixty subjects, both to 
confirm' the R and to observe the detailed relation of individual 
predicted scores to the actual scores. This is aliown in detail in 
the scatter diagram, Pig, 4. 
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RACIAL DIFFERENCES AS MEASURED BY THE 
DOWNEY WILL-TEMPEUAMENT TEST 


By John H. McFaddcn and J. P. 


INTRODUCTION 


Study of character and personality traits is, by ilH very nature, 
a fevplexir-g problem, aince there are a innltipiicity of factors 
entering into the make-up of any given indivkUuil, ainl since the 
erganixation of these factors varies so greatly with euch iniUvicUml. 
Several tentative elassiflcations of the traits nntl of the factors 
governing the combinations of the traits have been mnde. Wood- 
woi'lh* analyzes personality into four factors: Physiciuc, Clieniiciue 
or Temperament, Instincts, and Intelligence. F. II. and G. W. 
Allport' divide tendencies into; InteHigenco; Tempeviiment, includ¬ 
ing Emotional Breadth and Emotional Strength; Self-(!Xi)aiiaion, 
including Extro-Introversion, AscGndaiice-Submi.H.sinn, ExpfinHiciii- 
Ilccliision, Compensation, and Insight and Solf-EvjihiuLioii; and 
Sociality, including Social Pai-ticipatiou, Sclf-HcckiiiR luitl 
Aggressive Self-seeking, and Susceptibility to Social vStimuli. 
Tests for these were given, and the reanlls chcclanl by osLimutes 
of character and personality given by friends of the .subjects 
tested, The above division of tendencies is cunsiclitred by the 
writers as merely a tentative ono which may bo of sornu use in 
^'uiding further character analyaia. Watson^ givus a form for 
analysis of personality, and Wells' clnsaidcs the hcnlthy mental 
vefictiona as distinguished from unhealthy onea. II. T, Moore uml 
A. R, Gilliland* studied aggi’esaiveness as a per.somility trait, i.'^o- 
lating it as far as possible by selecting two gi'Oup.s of students, one 
composed of students rated as the most nggre.ssive iji their clus.s, 
and the otlier composed of students rated as the Iciiut iiggrossivo 
in their class. The following tests are suggested, n,s mea.surcinent.s 
of aggressiveness; oye movements; distraction from staring, from 
electrical shock, and from visual presentation of a .simkc | and ii 


aim'c<i"''NSw‘'Svk^*iun "/ /J/r. Ilcmy Ilnll 

• Allpoi't F. ir. and Alluovt, «, W. ■, 'iVirU VUtnal- 

clioln^y Abuorinnl I’syt-linloffy iirid .Sncliil I'Hy- 

T n the StainI|iomt 0 / ii JjcJinuli)r(,t(, 

,1, D, Llpplucol^ Co„ I’hllftflpiplilu. ' ' 

ObHcnaHon of, tltn lUrHiimilllif -In Jtn 

pp “Mhc .Uliul. I'HyeliuloKlral n<‘vli‘\v, V<il. Ul, iDM, 

Tounini^^of T?'’ A. n. The itconwemcnl uf AouirtmU'ciiCHfi. 

„lQUll\a» of ApuUi'C Psychology. Vol. No. 2, Jimc, l021. 
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word iiK!:o<'iaLi(in U'si. In llic alufVn icals, the fir.sL group scored 
high, and thi! J-e-rutuI group jMTored liiss, lluiH indicftting the value 
of the nuitluul.H uru-d. K. 0. Pillcr’ nUidied Ht'lf-As.surnnoa and 
Speed nf Decii'itiii, rntichuling lhal one tosil wu.s not gulViclont for 
cacli trait, hut that Uvn or niorc shoulil lnj given, Also, lie con- 
chuli'!'. Uii.l tliiTi' wiia iioL n very close cfirreliaion hetween speed 
of (Iceisjofi arid sH'lf-iiKSurriiicc. Thu losit used in the present 
Htndy of racial tlilTcrf'ncu.'i ia tin- Downey Will-TiciiperanvjiiL Test' 
fyrniiilalc<l liy Dr. J. K. lUiwni'y, of the University of Wyoming. 

Tlu; pnrLicnilav prohlom here aludiod is llic cojiiinirhnn of tem- 
pcraaiciit a:t found in iiulividiinln of the white anil negro ruce.s. 
ri'oviiiu.s .sLiidii's Iwtvc Ixa-ii nmde reBurding Ihe comparative in¬ 
telligence of Iho two races. Muyo* finds liiat, while the "data 
|)oinl:i clearly to a inensurnhle degree of menial (lilTorence,’' tlie 
(lin’erenoc'.s are of dej;rc'e, und not of khnl, und that mental varia¬ 
bility is .sl'gliLly le.ss in negro high school sLudents than in white 
high .school .Ktnilent'i- Fergusim", u.sing the Woodworth and Wells 
Mixed lieliilion.; Teals 1 and II, ii form of the ICl)l)inghau.s Com- 
pletlcn 'I'e.-it, a ('nta'ellalioii and one of the Columbia Mazo 

Te.sls, lind.s the inletlecUial p(‘i'foi'iniince of the general colored 
loi-iilati'en (o Ijc- approxiiimlely .seventy-five per cent ns eflicicnt 
as Lliiil of wliile.i, with the possihilily of negroes more nearly 
uppidacliihg whiTe.s in renaoniiig bused upon concrete uhject.s than 
in rea.siniiiig Ineu'd iijMin menial rupreK.jnLaluma of the objects, 
lie (iiid.H a itraclical mtuality in sense capneity in the perceptiva 
and dj.si;riniinaLive abililiiss, and, .since the dilferencc inu.st exj.sfc in 
the cenlral elaborative jmwer.s upon which thouBht more directly 
depends, he iiifors Ihtit kucIi iieursil difrui‘unce.s n« may bo foum! 
will lu'olnibly lie mainly in the con.stiLution of the cortical neurons, 
vallier Llian el.sc'wliere in the nervous .Hy.steni. Thi.s point will be 
taken up later, l''(;rgu.soii also .stales that, while no certain con¬ 
clusion iis to racial variability can be roached, it would be reason¬ 
able to su|i|K);;c tlml the negroe.s would vnry more than whites, 
.since the so-ciillod negro race i.s not nearly as homogenooii.s us the 


" I'lUi'i, It (I, -bi /:s/)nliHriit»l «/ f;/irtrrtr/«r 'J'rfilt/i. -.Tiaininl 

Ilf l''.vi Ii.ilnpv, Viii, :i No. I. lire ■■iiiliiT, lUci. 

' Ji-.IWJI *', -I, I-;.’ VJfr I V'c»i/«//i’i! tiri/lr for MriiH'iiciiii'Mt 

"I Ihf i i.htton'il fiillriu lUilv. uf >V\<intllia lIulli-llH, V<»l. 1.’, No. UA, I'l’b,, 

line, 

'I'hr \/lulcH<i;,l W .loiiriml of I'Miu'iUlDiiiil rsycliology, Vol. 

II. .S'o, a, Moi'iii. ii'oi). 

siiiiir ii,< lliiitiil I'lil irt'iiK Itrii'itli'l bit IIh’ U'lII-I’ro/llc, of 

llNpi'UiioHill] I'mvi liiilot'V. '‘nl. a. No. I. .\lltfusl. IIICO. 

.l/tiii-fti/ of /ifitt/HiiiM ffif 7’<wf/rt</. IImwIi I'o.. yfilikt'i'i-ori-iIiiilHDU, 

X. V , lli'JI, ... 

•Mii.vii. M Tlif UriHiil fiiiuif Uii uf f/ir Aii lilvi ii oi 

of l’.iv<'liol'.in\ Mi>iii>j:ia|i)i Nn. 'JM. luill . , , , 

’ I’l'iwiiHoii, C. II,. .1r. 'I’lii' /'0/rliolo(/// u( IJii' Al'i'liivin oj 

iioiii|.’j, .\i(iiti)K>'>iiiii Nil. .'US, ions. 
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white race. Derrick*'* finds that the ncffro college student is older 
than the white, that their average intelligenco quotient is nine 
points lower than the average white intelligence quotient, and that 
the white college student ia about seventy-seven per cent as vari¬ 
able as the negro college student. 

Turning from previous work on intelligence, and considering 
other studies of racial differences, we find several reports on dif¬ 
ferent traits. Stetson" finds practically no difference in memory 
in the two races, thougli there may be some doubt as to the value 
of this contribution, Cache" finds the negro quicker in his reac¬ 
tion time than the white man, and Garth" finds that there are 
alight difierences in their work curves—that there is a tendency 
of the negros to do more of their work in the first half of the 
allotted time than for the white workers. This would indicate 
that the negroes are more quickly aroused to work, but that, after 
the first spurt, their effort diminishes. Mitchell, Rosnnoff and 
Rosanoff'* in a study of association, find that negro children, on 
the whole, show further departure than white ones from the normal 
adult association standard. 

Before going on into our particular problem, it is necessary to 
note some cautions which experimental work has given. Pvessey’'*' 
warns that grade norms may vary very greatly in various schools, 
that there may be different age distribution, and that other factors 
may enter in. And, in a comparison of students of different races, 
it is all tho more important to bear this in mind, since grade norms 
will inevitably vary much more greatly in schools for different 
races than In different schools for students of the same race. 
ArUtt” fttida e tendency fov greater vo-viatlon (in results, from 
intelligence tests) in the same race but different social status than 
in the same social status but in different races. This latter point 
will be considered in the next section. Further, as Gatewood*' 
points out, there ia a tendency to rate negro children above their 
menial status, as compared with the tendency to rate whites at or 
below their true mental status. 

Di'i'ilcli, S. >1. .1 Sliulv or Ihe lutelUgcHce of ll'/i/fc a\til Vulnvctt 
Ciilleiic utiKlcnts. .IoiifudI of Applied rfijcliology, Vol. 4, pi). aiC-.SliD, De- 
vt'inliei-, 102U. • 

" StftsiHi, C. II. Some Memory Testa of IPfitfca a)Ml inccfca. rsycUol- 
OB-lciil Kovlcw, Vol. 4, pp. liBo-aSO, 1807. 

llnclic. n M. Kractiutt Timea Hefcrencc lo Jlnce. raycliologlcnl 
Ui'vk'w, Vol. pp, .J75-J80, 180.». 

'•* (iiu'Ui, T. H. U'ftife, Indian aiirt A'epi'a IVorfc Ciiruo.a. JouvnRl of 
Appilgd INyelioloisy. Vol. o, So. 1, MftvoU, 1H2\. 

" JIUclii’ll, J., Kosniiolf, I. H., nnd llosnnofC, A. .T. .1 ftliiili/ of ^is.ior/- 

filtoii 111 ^C|{ro Clillilmi. I'sycUolojflciil Ilfvlow, Vol. ‘JO, .ScpU-mboi', lull), 
'» l'u'R«cy, s. Ij. 'i'he nritiilcni of tlm Uusclceli'd (Ii'iiiip In llif 
afilkulluii of Tealg. Joimitil of Applied PsycliolOBy. Vol. .*», No. 1, Miirch, lUJJ. 

*“ Ailllt, A, II. On flip Xecd foy Onnfioit ta J-}hlatillaliliw JCm.c jYi/i iiia. 
Jouiniil of Ajipllcd J’HycIiology, Vol. 5, No. Ikliu-cli, Ht:Il, 

” UnWvi’ooil, 11 . L. 'J’rarlicrs' Usllmalca of Xearaea d/it? "Whites, .'^cliool 
nnd Society, Vol. U. pp. 00-01, 1019. 
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SUBJECTS AND TESTS 

The subjects tested were white and negro high school and college 
students. It was hoped, by choosing such groups, to eliminate 
many of tlio factors of selection, and to make the group.s more 
dii'cctJy comparable, niid also lo fix a general level of intelligence! 
between the group.s. It was found, however, that, in general, 
negro students of each grade were slightly older than white stu¬ 
dents of the same grade. This is conslontly found in eonipai’isons 
of white and negro students. Graphs and tablc.s follow, which 
endeavor to analyze the general results, and to interpret them in 
tei'ms of equal ages imd equal grades. Those results uve based 
upon the records of 38 high school and 39 college students from 
each race. 

The thirty-eight white high school students were tested at the 
Chapel Hill High School, and wei-c chosen at random, nearly all 
of the male students being taken- A note sliould be made here 
concerning tlie make-up of tJiis high school, since it is a little out 
of the ordinary. The high school students are drawn from three 
fairly distinct’social classes; those from the surrounding farm 
and mill districts, those whose parents nve in business in the town 
of Chapel Hill, and those whose parents are members of the 
Faculty of the University of North Carolina, A survey of gen¬ 
eral intelligence of thoso students with regard to tlieir respective 
social classes was made in 1917 by Chase and Carpenter and again 
in 1921 by Dashicll and Glenn, who found that the social levels 
and intelligence levels were strongly related. As might be ex¬ 
pected, the Faculty children led in genevnl intelligence, followed 
by the Town children, with the Out-of-Town group last. Chapel 
Hill High School embi’aces the 8th, 0th, 10th, and 11th grades, 
with seven years of grammar school work preparatory. 

The thirty-nine white college students were taken from classes 
in psychology at the University, the entire class in Abnormal 
Psychology being tested, and the balance volunteering from intro¬ 
ductory classes. Except for the very few freshmen and seniors, it' 
is a fairly typical group of college students. 

For the negro subjects, students in three negro institutions were 
tested. The National Training School, at' Durham, N. C., fur¬ 
nished five college students and all except two of the liigli school 
studeiits, There is some doubt as to the validity of all the re.sults 
from this group, since the testing was stopped, after forty sub¬ 
jects had been secured, upon evidence that some of the students 
were being cocachcd by their fellows. This would naturally affect 
the Reaction to Contradiction test, and it seemed to affect the 
Motor Inhibition and Co-ordination of Impulses tests, .since there 
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waa an unnabm'al tendency for the subjects to writa excessively 
slowly in the preliminary warming-up (Teat II, 3), and, for the 
Co-ordination of Impulses, to take great pains in adhering to the 
space limitations, but to fail in the time limitations. These 
tendencies were not noted with other groups, either of negroes or 
of whites. The doubt concerning coaching, and the foct that these 
testa and the norms for grading them were developed primarily 
for adults, would render the high school comparisons Bomewhat 
inconclusive, and would emphasize, the results from the college 
groups. 

The second group of negro students was from Shaw University, 
in Raleigh, N. C. The men tested were selected by the President 
of that University. Shaw University is one of the best negro insti¬ 
tutions in the South in regard to college ranking. Eighteen men 
were tested there, during a period of three days. The writer does 
not believe that any of the men in this group were coached. 

The last group of negro students was from the Negro Agri¬ 
cultural and Technical Scliool, at Greensboro, N. C. This is a 
state institution, but, owing to the fact that agricultural .schools 
usually, have lower standards of admission than the Colleges of 
Liberal Arts in the various Universities, it is possible that a 
comparison of the men in this group with men from the Univer¬ 
sity would be unfair. Still, the three negro school.s visited are 
typical of the institutions of that race, and the men afford a 
better basis of comparison, being more widely distributed, than 
if all the subjects were taken from one institution. At the 
Agricultural and .Technical School, eighteen men were tested dur¬ 
ing a'period of three days, sixteen of the men being of college 
grade, and two of high school grade, 

Although precautions were taken to standardize the subjects 
in regard to education, it must be admitted that the criticism of 
Arlitt'’ r'egarding differences in social status holds good here. 
Derrick" reports that "White boys from average environment go 
to cojlege nearly twee as frequently as negro boys from average 
negro environment"j thus, the negro college students are moi-e 
highly selected from their environment than the white students from 
theirs. The group of negro agricultural college students furnished 
a partial check on this condition, but for the best study in race 
companison, it would be necessary to select a large number of in¬ 
dividuals from all environments. The present comparison can 
.claim to hold good only for college a.nd high school students of the 
■ two races. 


“ A,', II- On Need for Cauliot), in Katahllfihln'j Jiacc Novnia. 

Jourufil of Applied L’aycliology, Vol. R, No. 1, March, 1921, 
n -t Of Iho ItUelliaeiide of 'White and Oolored 
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To better insure uniformity in veaults, all of the tests here 
reported were given by ono of the writers nnd were graded by him. 
The grades were checked by the same writer and by a student 
trained in tlio method of grading. 

It is not tliought heee.sanry to give an exhaustive description 
of the VVill-Temporument Test, but definiUons of the traits scored, 
and li statement of the value of the .scorua in cneij, ai'e iicce.Hsnry 
for a full understanding of the rcBiilts, In the order in which 
they are listed by Prof. Downey”, they arc: 

Speed of Movement: tSpeed of niovernGiit of person relative to 
size and age. A score of "10" hero indientca a very high speed, 
grading down to "1", which indicates very .slow iiiovemont. 

Freedom /)'07n Loud or Inertia: Tendency to work at one’s 
highest speed without external pressure, little tendency to relax 
speed, quickness in warming up to n task. A .score of "lO” indi¬ 
cates practically uniform speed, "1" indicates great Increase, which 
may moan that the subject usually works more slowly than he 
could—that ho has exccasivc "load” or weight of inertia. 

Flexibility; Ease and success in rendjustmei^t; capacity to 
modify one's routine rcnctions. A score of "10" here indicates 
highest success, "1," practically failure. 

Speed of Decision: Quickness in reaching it decision or con¬ 
clusion. A slow reaction hero may be duo to caution or con¬ 
servatism in weighing the elements involved in a situation, or be 
caused by one's being side-tracked by irrelevant matters or a 
rambling procedure. Here "lO" indicates a speedy decision, "1", a 
very slow fleci.sion. 

Motor Ivipiilsion: This trail refers both to impetuosity and 
energy of reaction. Consider the ease with which tlic brakes or 
inhibitions can be removed, and also the tendency to explosive re¬ 
action when the brakes are actually off. A "10" here indicates 
explosive or expansive reaction under distraction, grading down 
to a "1,” which indicates inhibition or withdrawal into one's self. 

Reaction to Contradiction: This refers to the degree of con¬ 
fidence with wliich ono maintains his opinion against contradic¬ 
tion. A ‘‘9” or "10’' reaction signifies an aggressive subject—the 
burden of proof is thrown on the person who does tlie contradict¬ 
ing; "7" and "8" are confident reactions, but reasons are cited for 
one's confidence and the burden of proof is accepted; "5" and "0" 
are tactful reactions; below "B" there is ii grading down to com¬ 
plete failure to a.ssorb one’s own opinion, 

i2e.sista7icc to Opposition; The vigor with which one reacts im¬ 
mediately to n blocking of one’s purpose. It grnde.s from ‘‘10’’, a 

IDowni'j- .7. K. .Ifaiiiinl «/ iilrcotiimtt for TcsUnp. World Book Co., 
irouJccrs-oii-iriidsoH, N. Y.. JOliJ. 
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strenuous reaction, to "1", complete passivity in the face of 
opposition. 

Finality of Judgment: Confidence in previou-s decision, willing¬ 
ness or unwillingness to reopen a question once closed. A ‘10’^ 
indicates refusal to reconsider, or a very rapid reconsideration, a 
“I” indicates extremely slow reconsideration. Sometimes the sub¬ 
ject spends as much time on review ns he does on the original 
decision. The score in this trait should he interpreted while bear¬ 
ing in mind the score or time spent on the original decision. 

Motor Inhibition: Capacity to keep in mind a set purpose and 
achieve it slowly. It involves powei* pf motor control, imperturba¬ 
bility, and patience. A score “10” indicates highest success, a 
“1" indicates practically no inhibition. 

Interest in Detail: Attention to details. This trait is not equiv¬ 
alent to accuracy, but rather it indicates thoroughness, which may 
or may not be accompanied by analyticol thought or’ insight. 
A "10" indicates highest cate for details, a "1” shows very 
little care. 

Co-ordination of Impulsea: Capacity to execute a double task 
without preliminary trial, capacity to,handle a complex situation 
successfully without forgetting elthor factor involved. This trait 
is probably allied to keeping one's‘head in a confusing situation, 
A “lO” here indicates greatest ancceas, a “1" indicates practically 
failure. 

Volitionat Peraeueratitm; Absorption in- a task; -willingnesa 
to keep "plugging away" at it because the examinee sets up a 
goal for himself. A “10” here is also the most desirable score, 
while a “1" indicates little desire to take pains in perfecting h. 
piece of work that the. individual takes personal pride in. 

The scores in the Downey tests were obtained by taking the' 
records of a large number of individuals, for some given traits 
and assigning score values in such, a way that 10 per cent of 
the persons tested attained each score. Thus, in a given group, 
W8 could hardly expect to find normal distribution curves for the' 
various traits, but rather a tendency for an equal number to 
attain each score. Further, the total score made on the teat is 
not as significant as the grouping of the scores in the various, 
traits, although it has been considered that a high total score 
indicates a "strong" personality, and a low total score indicates 
a \ weak" personality. Also,, the testa and grading norma were, 
dovised for adults, and this should be taken into consideration 
when these tests are given to younger subjects. 

G. M. Rush” gives a criticiam of the Will-Tempcrnmcnt 


Studff of the Ooirelaltona Uctioecn 
T.? 2ia«s Olid the Reaulta froinUho Downcit '‘MUli^pyodle”' 

JournM ol Applied Psyehology, Vol. 6, Mo. 2, June, ikl 
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Test, in vegni-d to corrolotion of the reaulta ftnd estimnLos. Ho 
finds, foi’ fifteen fiuhjccts, very little coi-relfttion between the 
estimates of the traits imd the scores in thofic tvnits as tested 
by the Wili-Tcmpernnicnt Teat. Prof. Downey”' however, 
nsinu n gliehtly difTerent method of estimates, found suiRciezit 
correlntion to justify the testa. 

RESULTS AND INTERPRETATIONS 
Table I contnina the ftiintmary of iiieon.s and modian.s of the 
scoro.") in the various trails for the two vnccs, divided into collcg^e, 
hifi:h school, and combined group.s, with the standard deviation 
from the mean in the various traits for the two college groups. 

TABLE I. 

College Students High School Combined 
WIIJTi; HTUPHNTH 


Tmlt 

Mvnii S. I>. 

.Mcdlnii 

Mean 

Mi’dtfin Mean 

MpiIIaii 

Speed of Movement .. 

.6.77 2.631 

7 

4.13 

3 

B.4G 

6 

Freedom from Load ... 

.6.41 2.627 

6 

0.71 

7.6 

C.OO 

6 

Flexibility . 

.6.16 1.740 

5 

4.13 

4 

4.C6 

6 

Speed of Decision . 

....4.10 2.888 

4 

3.21 

3 

3.06 

3 

Motor Impulsion . 

.4.C1 1.781 

6 

3.76 

4 

4,14 

4 

Reaction to Contradiction 6.79 2.461 

7 

B.BO 

6 

8.06 

0 

Resistance to Oppoaition 6.77 2.731 

7 

6.80 

7 

6.03 

7 

Finality of Judgment .. 

.4.92 2.392 

6 

6.60 

6 

6.26 

8 

Motor Inhibition . 


6 

4.60 

6 

6.01 

5 

Interest in Detail . 

.7.33 1.489 

7 

6.44 

6 

6.80 

7 

Co-ordination of 







Impulses .. 

.0.02 2.882 

7 

3.06 

2.6 

4.82 

4 

Volitional Peraevcrfttion..0.04 2.966 

8 

6.81 

6 

G.23 

7 


NEOIIO STUDENTS 





Trnlt 

M«»n H. D. 

Mcdluii 

Monn 

Medina 

Mcnn 

Medina 

Speed of Movement. 


3 

3.UB 

2 

3.60 

3 

Freedom from Load ... 

.B.48 2.716 

6 

6.87 

B 

6.67 

5 

Flexibility . 


4 

4.23 

4 

4.11 

4 

Speed of Dcci.aion.. 

.3.87 3.048 

2 

4.71 

4 

4.28 

3 

Motor Impulsion . 

.B.I6 1.956 

6 

6.47 

5 

6.31 

5 

Reaction to Contradiction 6.10 1.997 

7 

6.81 

7 

6.45 

7 

Resistance to Opposition..B.33 2.641 

6 

6.06 

5 

6.19 

6 

Finality of Judgment . 

.4.77 2.301 

6 

6.29 

7 

5.62 

6 

Motor Inhibition . 

.3.84 3.519 

3 

6.76 

8 

6.28 

6 

Interest in Detail .. 

.6.82 2.146 

7 

6.52 

7 

6.67 

, 7 

Co-ordination of 







Impulses .... 

.3.87 2.838 

3 

2.13 

1 

3-01 

2 

Volitional PcrsevcrQtioTi...6.69 2.624 

6 

5.80 

7 

6.74 

7 


’’ Doivney, J. R The 1VHI-J‘rofllc, A Tentative Bvnlo for Mensurement 
of Uio VoMtlonol Pattern. Unlv. of Wyoming Bulletin. Vol. lli, No. OA, Feb. 

ibio. 





















38 


McFADDEN—DASHTELL 


Attention must be called to the fact that a composite profile 
plotted from mean or median scores, as given in Figure 1 and 

FIGURE 1. Mean Scores. 
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Figure 2, must be read nrith caution, since there is so great pos¬ 
sibility of individual vai'iability in the a:ore8 in each trait. Also, 
these profiles do not indicate, more than in a very general way, 
tendencies toward racial patterns. However, from Table I, and 
Figures 1 and 2, we may say in general that the "average” 
white student has greater speed of movement, that he has slightly 
greater freedom from load—^that is, he tends to work on the 
weighing of the evidence, or leas decisiveness; that he is slightly 
average more nearly at his greatest speed; that' he has slightly 
greater flexibility and ability to ^eet new conditions in life; that he 
is slightly' slower in making decisions—which may mean a better 
less liable to become explosive under distraction from conflicting 
stimuli; that he is less forceful when contradicted, which may mean 
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n ^renter degree of sociul udjiistmont (n score of ‘Ti’' is the tact¬ 
ful response), or n greater degree of siiggoslibility; that ha is 
firmer when confronted by obstacIcH or physical ojipo.sition; that 
he takes about the same time, or slightly longer in reconsidering 

FKiUIlE 2. Median Scores, 
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his decisions, which may be due to enre, or to greater 

indecision; that lie has, us a college student, greater ability or 
desire to restrain his inipulses, and, ns a high school student, less 
ability or desire (but here must be remembered the criticism given 
above, that there was some evidence of coaching upon the results 
from negro high scliool students); that he has practically the same 
interest in detail; that ho has a markedly greater ability to co¬ 
ordinate his impulses, or to meet confusing situation; that he 
has a slightly greater tendency to volitional perseveration. 

Figure 3 shows the distribution of the individual scores in each 
trait, for the high school students, the college students, and the 
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combined groups, of both races. Score values are indicated on 
the horizontal axis, .number of indWiduals on the vertical. 

The median profile of the high school students (Figure 2b) 
shows emphasis on the traits which combine to suggest an aggres¬ 
sive personality, a result which was found by Dr. Downey” 
in testing high school freshmen. 

A point *wey here he brought out in relation to the negro’s 
tendency to resist contradiction more strongly than the white. 
Dr. Bevis”, tabulating tbe frequencies of various forma of 
psychoses among the Southern negroes, reports that dementia 
praecox stands at the head of the list of their psychoses, with the 
catatonic form occurring about twice as often as in the white. 
Since one of the characteristic symptoms of the catatonic form 
of dementia preacox is negativism, the result of this test checks 
fairly with Dr. Bevia' report Also, (and cf. No. 6 in "Summary'') 
we might expect a greater degree of aggressiveness from the 
negro when he is allowed to reveol bis inner self. As a race, 
they are generally oppressed or held down, a fact which might 
lead us to look for a reaction in the direction to greater nggres' 
siveness when unchecked. Observations of’Northern negroes have 
been reported, where the negro, freed from race restraints, has 
swung to the other extreme and has been rather too aggressive; 
and the-tendency of the negro drivers to beat their mules more 
mercilessly than do white drivers, is a matter of observation, 
This is apparently a case of "inferiority complex" and "com¬ 
pensation". 

The lower score of the white students in motor impulsion might 
have been expected. Odum” says, "The two general character¬ 
istics, then, the negro's emotional nature are the lack of restraint 
and the consequent extreme expression of the feelings." Theoe 
Avould naturally be allied with greater motor impulsion. 

. Various investigators have made different reports regarding 
the variability of the negro as compared with the white. Fergu¬ 
son” says that no certain conclusion as to racial variability can 
be reached, adding "It may finally be remarked with vegai'd to 
the relative variability of whites and negroes, that it would not 
bo at all surprising if groups of so-oalled. negroes were definitely 
shown to he more variable than comparable groups of whites. For 
■the groups that are generally called negroes are composed of in- 
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FIGIJUK 3. 

Distribution of Individuiil Scores in the DifTercnL Traits. 

_NeijroGa _ _ . WliiLp.s 

laoiLScnoo^ coLi^ni couoni(a> 



oe^ooio oe>iadio oe^eoia 

Preoloffl fren L94(l • 



oa-ieoio 0S4C0 10 oaieaio 
PlexlbllLt; 



Spaod or Deotglon 








McFADDEN—DASHIELL 


FIGURE 3. (coiit.) 

HIOH acnooi COLLEOE OOMBIKfiD* 












RACIAL DHJ^-'ERENCES 
FIGURE 3. (cpnt.) 

HIQH SQHWL COIXBOB COUBQCBD 



8400 10 OBlAOlO OCiSOlO 
Motor Inhibition 



8460 10 OBI'BOIP 00400 10 

Interest iniwtill 



VoKtlorikl FarisverLtloD 








44 


McFAPBBN—DASHIELL 


dividuflls ranging from ptfre negroes to persons slmost white, 
nnd it would be reasonable to suppose that such groups would 
vftry move than would homogeneoua white groups." Mayo” states 
that mental variability is less in negro high school students than 
in white high school atudents. the rntto heing ^3 to 100. Derrieh*' 

TABLE II. 


Comparison of the Standard Deviations of the Scores Made by the 
White and Negro College Students in the Various Traits 

White Negro White Per Negro Per 


Trait 

S. D. 

S. D. Excess 

Cent Excess 

Cent 

Speed of Movement. 

....2.631 

3.070 



.639 

21.3 

Freedom from Load . 

....2.537 

2.716 



.179 

7.0 

Flexibility ..-. 

....1.740 

2.000 



.260 

14.9 

Speed of Decision . 


3.045 



.157 

6.4 

Motor Impulsion .. 

....1.781 

1.965 



.174 

9.7 

Reaction to Contradiction - 

....2.451 

1-997 

.454 

22.2 



■Resistance to Opposition ..... 

....2.731 

2.641 

.090 

3.4 



Finality of Judgment . 

....2.392 

2.301 

.091 

3.8 



Motor Inhibition ... 

...‘.3.409 

3.519 



.110 

3,2 

Interest in Detail .. 

....1.489 

2.146 



.667 

44.1 

Co-ordination of Impulses ,. 

....2.882 

2.838 

.044 

1.6 



Volitional Perseveration . 

.....2.966 

2.524 

.441 

18.2 



Average Per Gentage 







of Excess .. 




9.8 


16,1 


finds the opposite in regard to college students, when compared 
in respect to intelligence. He says "The white college student was 
about 77 per cent as variable as the negro." Nor ia anything 
definite concerning variability found in the results from the Will- 
Temperament Tests. Inspection of the distribution curves for 
the scores in the various tests (Figure 3) shows practically no 
preponderance of either race. Comparison of the standard devia¬ 
tions from the mean in the scores made by college students, 
Table 11, shows that the negro deviations exceed those of the 
whites in seven of the traits, and- that the amount of excess is 
relatively greater. There would, then, seem to be a slight but 
not striking tendency for the negro to be more variable. 

After the comparisons given above were made, the results were 
analyzed in terms of ages and academic grades, Except for the 
preponderance of freshmen'in the white high school group, and 


« Mayo, M J. The Meiiiat Gapaoltj/ of the Avtci-lctin Nenro. 
of Psychology, Monograph No. 28, 1013. “ 
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TABLE III. 





Diatribution of subjects by ages 

nnd grade.s. 





WHITE 

HTtIDBNT.S 





High School 




College 



Age 

Freah. 

Soph, 

Jun. 

Sen. 

Freah. 

Soph. 

Jun. 

Sen» 

10 

1 








11 









12 









13 

5 








14 

2 

1 

1 






15 

5 

1 

1 






16 

3 



1 





17 

1 

1 


2 

1 




18 

2 

1 

1 

1 

2 

B 



19 

1 




1 

6 

3 

L 

20 

1 

1 




5 

3 


21 


2 

1 



3 

4 


22 


1 




2 



23 

1 





1 



24 







1 


26 









26 






1 



Total 

22 

8 

4 

4 

4 

23 

11 

1 




NEGRO 

1 STUDENTS 





High School 




College 


Age 

Fresh. 

Soph. 

Jun. 

Sen. 

Fresh. 

Soph. 

Jun. 

Sen- 

12 

1 








13 









14 

2 








16 


1 







16 

1 








17 

2 




1 




IS 

3 

6 

1 

1 

1 




19 

2 

2 

1 

1 

1 

2 



20 


1 

2 

1 

3 

2 



21- 



1 

1 

2 


2 

1 

22 






2 

1 

1 

23 

1 


1 

3 

1 

1 


2 

24 



2 


1 

1 

2 

2 

25 



1 



1 

1 


26 




1 



1 

2. 

27 





1 



3 

28 








1 

T4)tQl 

12 

0 

9 

S 

11 

9 

7 

12. 
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TABLE IV. 


Mean scores by ages of subjects. 
WHITE STEDEKTS 


Age 

SM 

PL 

F 

SD 

Imp. RC 

RO 

FJ 

Inh. 

ID 

Cl 

VP 

10-lG 

S.81 

6.38 

4.24 

3.38 

3.90 6.81 

4.81 

E.66 

6.7G 

8.76 

4,38 

6.28 

n-19 

6.66 

6.07 

4.89 

4.20 

4.79 6.00 

6.14 

5.38 

6.24 

7.14 

B.20 

6.07 

20-22 

6.43 

6.82 

4.78 

3.48 

3.69 6.91 

6.69 

4.78 

4.17 

G.82 

4.56 

6,62 

23-28 

6.7B 

B.76 

B.50 

2.25 

3.2B 7.B0 

6.00 

5.00 

3.76 

6.25 

B.76 

B,B0 





NBGllO STUDENTS 






Age 

•SM 

PL 

F 

SD 

Imp. RC 

RO 

FJ 

Inh. 

ID 

Cl 

VP 

10-16 

2.00 

3.40 

4.20 

4.80 

6.40 6.00 

5.40 

7.00 

7.20 

6.80 

2.00 

6.00 

17-19 

2.35 

6.74 

3.87 

4.66 

6.49 6.69 

5.17 

6.09 

6.26 

5.66 

2.69 

6.22 

20-22 

5.16 

6.30 

4.10 

6.00 

4.86 6.10 

6.00 

6.96 

4.60 

6.95 

4.00 

6.40 

23-28 

3.02 

6.68 

4.31 

3.24 

6.66 6.48 

5.31 

4.66 

6.62 

B.S4 

2.76 

6.79 

For number 

of subjects in 

1 each-group, 

and 

grades represented, 


see Table 3. 


Figure IV. 
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<if sophomores in the white cotlege proup, the (iistribuLioii of sLu- 
dcTita is npproximutcly the name in both rncoH. Table III hIiowh the 
distribution by afjo ami j>rmlc.s. From inapcotioii of thi.4 table, 
it is seen at once Dutt the noffro Atudent ia fj'oni two to three 
years older than the while Hludcnt of Uuj .Htiino prade. Tliia 
retardation nuiy be caused by n«lv«rsc environment or by inferior 
intelligence of the negro. Prohiibly both factorH are at work. To 
eliminate as much us possible the iiiHucncc of ape on the scores 
made by the group.s, the siiJijcets wore divided into four Hretinns, 
the first section contarniiip those 10 years of tipc jitul younger, 
the second section contuiniiiK IhoHc from 17 through 10, the third 
those from 20 through 22, und the fourth those 23' and above. 
Table IV gives the mean scores made by each section in each 
trait and Figure -I shows the profiles plotted from these data. It 
will be .seen from inspection that, n.s the subjects grow older, there 
is a tendency for incrensed scores in speed of inovomont, flexi¬ 
bility, i-cacLioii to coiilrndiclion, and co-ordination of impitlsc-s; a 
tendency for decreased scores in speed of decision, flnnlity of 
judgment, motor inhibition, and perhaps volitional persevera¬ 
tion; the scores for motor impulsion lend to remain about the 
'.same; in freedom from loud, the white scores remain about the 
same, or decrease slightly, while the negro scores increase with 
age; in rc.si.stanco to opposition, Ibo white scores incroa.se, and the 
negro scorc.s remnin aboul the same; in interc.sl in detail, the 
ivliito acorea decrease sHglitly, while the negro .‘{corea vary, The 
mcreasG in .speed of movement may be due to inci'casod use of writ¬ 
ing, the necessity for rnpid nolc-tuking, or the influence of other 
situationa in every-day school life that call for speed in writing. 
The increase in the throe other trails noted would probably be due 
to a deeper reniizotion of problems as such, nnd the con-seriuent 
tendency to eliminate "snap judgments". The decrease in motor 
inhibition nnd volitional perseveration may be due to the greatei’ 
value which the older per.son puts upon time, or, in the case of 
motor inhibition, the decrease of content which the tost-phruse 
holds for him, und the coiiscquenl Uicreaae in difficulty of the 
tost. A person’s rating in motor impulsion is probably a 
fundamental part of his make-up, enil would hardly be expected 
to change in either direction- A true race difference may be 
indicated by the difference in the change of scores foi* freedom 
from load, in which those for the whites I'emuinod nearly conatniit, 
and those for the negroes' increased. The negro score in this 
trait never increased enough, however, to bring it up to the lowest 
score of the whitc.s. In such a trait as resistance to opposition, 
the increase in white scores, while the ncgi’o scores remain nearly 
• constant, may indicate an curlier maturity on the part of the 
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negro. The decrease in Scores for the white students in interest 
in detail may indicate, os noted above, on increased valuation of 
time, 

In order to check the above classification of the groups into 
age-sections, another classification was mode, this time into grade- 
sections. Here it is evident, the factors of intelligence and greater 
capability come into play, ond we may be fairly sure that the 
higher the grade, the higher the intelligence level,, since there- 
is a selective factor at work to eliminate those of less native 
capacity. Table V gives the mean scores attained by the various. 

TABLE V. 

Mean scores by school grades of subjects. 


WHITE STUDENTS 


Grade 

SM 

PL 

P 

SD 

Imp. EC 

RO FJ 

Inh. 

ID 

Cl 

VP- 

HS 

1-2 

S.66 

6,46 

3.93 

2.76 

3.70 B.GO 

5.60,5.36 

'4.3C 

6.16 

3.90 

5.66. 

HS 

3-4 

6.26 7.62 

4.B7 

4.87 

4.00 6.12 

6,60 6.60 

5.60 

7.60 

3.62 

5.85 

C 

1-2 

7.04 

6.74 B.04 4.00 

4.33 6.89 

B.74 4.88 

6.96 

7.22 

6.44 

6.58 

C 

3-4 

6.08 

7.66 

5.41 

4.33 

4.91 4.83 

5,83 5.00 

4.17 

7.68 

5.08 

6.75 






NEGRO STUDENTS 





Grade 

SM 

FL 

F 

SD 

Imp. EC 

EO PJ 

Inh. 

ID 

Cl 

VP' 

HS 

1-2 

2.09 

5.09 

3.38 

4.33 

6.57 6.47 

5.00 6.81 

6.38 

4.91 

2.33 

5.71 

HS 

8-4 4.06 

6.82 

4.23 

5.18 

5.S6 7.23 

6.12 6,66 

7.23 

7.20 

1.88 

5.88. 

C 

1-2 

4.40 

6.25 

4.06 

4.76 

4.95 5.85 

B.6B 6.20 

6.46 

6.16 

3.65 

6.30 

c 

3-4 

8.86 

6.79 

3.96 

2.96 

4.84 6.37 

5.42 4.21 

3,79 

7.68 

3.89 

6.10 

Average ages of above groups; 












HS 1-2 

HS 3-4 

C 1-2 I 

C 3-4 



Whites , 




.16.3 

17.0 

19.74 

20.33 



Negroes 




.17,66 

21.69 

21.2 

25.68 



For distribution of ages, and numbers in each group, see Table 3. 


sections, and Figure 6 shows the profiles plotted from the data. 
In this case, with increase in grade, there is an increase in the 
scores of more traits than when the student’s increase is in age. 
Inspection shows that there are increases in the scores for speed 
of movement, flexibility, resistance to opposition, interest in detail, 
co-ordination of impulses and volitional perseveration. Finality 
of judgment is the only trait in which, there is a decrease. Th&- 
scores for freedom from load, reaction to contradiction, and motor 
inhibition remain about the same, or' vary irregularly. There is 
a slight increase in the scores for speed of decision and motor 
impulsion for the Avhites, with a decrease in these traits for the 
negroes. With increased intelligence and stronger personality, one 
would naturally expect higher scores. For finality of judgment,. 





]tACIAL DlFFIcnKNCKvS 


49 


the decron.sD ia from above "5" li> about "!>'* whiclj ia t)ie normal 
score. The advanced BtudGiils Hcem to be l«aa addicted to hn.sty 
rcviaion. The constancy of the trnilH freedom from load, reaction 
to conlrndiclion, and motor inhibition, inny indicuto tlmt normal 
scores in these traits uro Hunicicnt for proliciency in school work, 
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although it would seem that the advanced student would gain in 
resistance to contradiction. The opposite direction in which the 
scores tend, for the two I’aces, in speed of decision and motor 
impulsion is probably indicative of racial characteristics, and may 
oiFer good returns for further investigation. 

Since, as slated in the first pari of thi.v section, a study of mean 
or median scores offers little that is definite in the way of racial 
temperament patterns, the scores for the college students were 
gone over in an attempt to list any tendency toward groupings of 
the high scores found there. Following Professor Downey in the 



BO 


McFADDEN—DASHIELL 


main, wc may suggest that there are three types of such group¬ 
ings—those in the traits listed as the first four chaructovizing one 
as mobile or rapid-fire in organization, na the second four charac¬ 
terizing him as aggressive or forceful, and as the third four the 
controlled, deliberate, careful type. Also, there may be combina¬ 
tions of any tw groopinge, or of none at all—the profile may 
be balanced or else very irregular. The n^clhod followed here 
in listing tendencies was ns follows: The Rrat four scores in 
each individual’s case were added together, us were the second 
and third sets of fours. These sums were compared, and when 
the sum of one group exceeded the sum of either of the other 
groups, the individual was listed as being clinracterized by the 
tendency correlated with that group. Where no one group ex¬ 
ceeded either of the others by three or more points, there were 
two possibilities—either that the individual had a well balanced 
profile, or else there was a combination of two high groups ond 
one low one. If the first was the case, he was listed ns "Balanced”; 
if the second was the case, he was listed under the combination 

TABLE VI 

Showing distribution of college students aceorcliiig to the group of 
traits in which eneh received his highest scores. 

1st 2nd 3rd 1 st and 2nd 2ndand3i’d Ist and 3rd Balanced 

Whites ...4 G 14 1 C 5 3 

Negroes 2 9 8 4 8 3 5 

of his two high groups. Table VI gives the results of this attempt 
to classify the patterns. From this table we may see that the 
whites slightly surpass the negroes in the numbor of mobile, rapid- 
five individuals; they have a clear superiority in the number of 
controlled, deliberate, careful persons; and they slightly surpass 
the negroes in the number of individuals showing a combination 
of these two characteristics. The negroes slightly surpsuss the 
whites in the number of aggressive persons a^d irv the number 
of persons combining quickness and mobility with aggressiveness, 
and also in the number of individuola combining aggressivenosp 
and deliberation. 

As a last point. Professor Downey suggests that, while there is 
not AS much significance attached to the total score of each individual 
ns to his scores on various traits, still, a high total score is, in 
general, indicative of a “stronger personality," and a low total 
score is indicative of a weaker personoUty. On this assumption, a 
tabulation of total scores of the college group was made, and a 
distribution curve was drawn from the reaulta. See Figure G. 
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FIGURE 6. 

Distribution of total scores of College students. 
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Six negroes (IB.4%) passed the white median. 


It WHS found that tlie white college students surpassed the negro 
college students in their totals, which, therefore, would indicate, 
that, in general, tJie whites have **greoter force of personality." 



g2 McFADDEN—DASHIELL 

SUMMARY 

1. In general, the negro is slower in movement than the white,, 
has'about the same or slightly greater load or inertia; has alightly- 
less flexibility; is slightly quicker in making his decisions; his 
motor impulsion is slightly greater; reacts more firmly against, 
contradiction; but offers less resistance to physical opposition; 
takes about the same or slightly less time in reconsidering his: 
decisions; the negro college student has less motor inhibition, the 
negro high school student has greater, compared with white stu¬ 
dents; the negro has practically the same interest in detail as the 
white, has markedly less ability in co-ordinating his impulses; and 
has a slightly less tendency to volitional perseveration. 

2. There is little difference in variability, but the negro college' 
student has greater variability on seven of the traits, as opposed 
to the greater variability of the whites in five, and the nmoU'nt of 
the negroes' variability is slightly greater. 

3. -In general, the negro college and high school student ia, 
from two to three years older than the white student of the same, 
academic grade. 

4. As to the influence of age (from early adolescence to the 
middle twenties, as the subject approaches maturity, there is a 
tendency for increased scores in speed of movement, flexibility, 
reaction to contradiction, and co-ordination of impulses; a tendency 
for decreased scores in speed of decision, finality of judgment 
motor inhibition, and volitional perseveration, the scores for motor 
impulsion tend to remain about the same; in freedom from load, 
the white scores remain about the same, or decrease slightly, and 
the negro scores increase with age; in resistance to opposition, the 
white scores increase and the negro scores remain about the same; 
in interest in detail, the white scores decrease, while the negro- 
scores vary. 

6. As to the analysis of mean scores by grades (probably in¬ 
fluenced by the factor of increasing intelligence in direct ratio to 
the higher grades): the scores for speed of movement, flexibility^ 
resistance to opposition, interest in detail, co-ordination of im¬ 
pulses, and volitional perseveration increase in the higher grades* 
the scores for freedom from load, reaction to contradiction, and 
motor inhibition vary; there is a slight increase in the scores for 
speed of decision and motor impulsion for the whites, with a de-’ 
crease in these traits for the negroes, from the lower,to the higher 
grades. 

6. In predominance of temperamental patterns, the whites, 
slightly surpass the negroes in the number of mobile, rapid-fire 
individuals; they have a clear superiority in the number,of con- 
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trolled, deliberate, careful persons; and they slightly surpass the 
negroes in the number of individuals showing n combination of 
these two characteristics. Tho negroes slightly surpass the whites 
in the number of aggressive persons and in the number of indi¬ 
viduals combining quickness and mobility with aggressiveness, and 
also in the number of individuals combinii\g aggressiveness and 
deliberation, 

7. In “strength of personality," ns indicated by the total score 
of each individual, the whites surpass the negroes, only 15.4 per 
cent of the negroes exceeding the median of the whites. 



A STUDY OF THE DATA ON THE RESULTS GATH¬ 
ERED FROM repeated MENTAL EXAMINA¬ 
TIONS OF 200 DEFECTIVE CHILDREN 

attending special schools 

OVER A PERIOD OF EIGHT 
YEARS 

By Meta Anderson 
Director Binet Clnsses, Newark, N. J. 

AltRoug^ work ior detectives v»ns begmi in Nev?nTk in Sep¬ 
tember, 1910, it was not until 1918 that the organization of the 
work permitted anything Hite systematic rc-examinntion of the 
children admitted to the special schools and even then comple'te 
yeni’ly re-examination of the whole special school population was 
not accomplished. However, since 1916 it h.as been possible to 
re-examine each child in the special schools yearly excepting a 
■few eases which will be noted later. The object of the work was 
to get information in regard to the growth of intelligence of 
the children in the special classes (now called Binet Classes) in 
order, if possible, to know better how to train them and to 
eliminate errors in their trainlne and education. The object of 
this study was to organize, classify and analyze these data in 
order to get further information in regard to types of mental 
growth curves and in order to get further information in regard 
to the value of the intellieence quotient. 

While the population of the Binet Schools is upwni’d of five 
hundred pupils only two hundred were studied here. These two 
hundred cases vary from the grade of low grade imbecile to 
that of high grade moron. Before Januavy, 1918, the cases were 
, selected for the Binet schools because they were failures in the 
regular grades and aC the same time fell more than three yeors 
below normal according to an intelligence test (this standard 
being set by the New Jersey law). Since January, 1918, the 
cases have been selected by the Psycho-Educational Clinic of the 
city, Each case is eeriifled as being definitely feeble-minded 
before being sent to a Binet School. 

Each case was examined from three to eight times at not less 
than a year's interval. The majority of the cases were re¬ 
examined by the writer. The others were examined by two head 
assistants in the department both of whom were unusually well 
trained to do the work. 

In a department always having a population of 600 defective 
children it would seem possible to have numbers of retests on 
at least that many children. This investigation has shown that 
the turnover in the population of the Binet Schools is very great. 
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Mniiy of the chililvon except the lowest grade arc assigned to 
special work Into in their sclinol enveer. These children are not 
presented for p.sychnlogicul cxoJninntion «3)U1 tlie regular schools 
have clone all in their power to help them succeed in their work. 
Hence, it is only after their inability to Icnrn has become most 
marked or their I)el;avior diaorclers have become unbearable that 
these cliilcirc'j) are a.s.signed to the Hiuel Schools. By that time 
the children are anywhere from ten to fourteen years of age. 
Since they leave! school iiL sixteen mul ai)motime.s earlier as 
during the war when the pre.s.sure for workers was very great 
these clilldren liavo short oppoi'Luiiity for training. Tlii.s also 
renders it imjiossihle to have a gx'eat number of retests on the 
same individual, 

A certa’n percentage of Ihis group also leave school to go to 
hou:cs of correction, to iiistitiilions, move from the city or are 
lost trad; of. Therefore the number remaining in the Binet 
School.-: fer moi'c than four years is comparatively few. 

V/ith the present wider use of group lest.^ defective cluldren 
arc lierng cliscnvercd earlier in their school cai'eer but it will be 
necessarily n jjumber of year.s before siiflicicrit dflln are g-nthorod 
on this new group for a worthwhile study. 

Before 1918 the Goddard revision of the Binet tests were used, 
since 1918 the ytnnforcl revision of the Binet tests have been 
used. 

The study falls into two parts. The first part has to do with 
the frequency of types of mental growth curves and the second 
part hos to do with ii study in values of the IQ. 

PART 1. FREQUENCY OP TYPES OP MJ5NTAL GROWTH 

CURVES 

Other lNvr.sTir,ATioNs. 

Kuhlmnn has made growth curves on data gathered from re¬ 
peated retesta on inmates of the Minnesota institution and, he 
says: "The main features of these gi'owth curves present but 
little that is not now pretty well known, They show that the 
feeble-minded do develop mentally, and at a rate in proportion 
to-the grade of intelligence. This was still a disputed point at 
the time this study was begun. This rate of development de¬ 
creases with age for all grades. The rate of this decrease 
cannot, of course, be shown with this data, as we do not know 
how much mental growth in terms of absolute units the mental 
year represents at different age levels.” 

Kuhlmnn summarizes his results on mental nge growth ns 
follows; 
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"1, The mental &ges of the feeble-minded increase with age 
at a rate proportionate to the degree oi hvental deftcieTicy. 

“2. On the whole the mental age ceases to incronse between 
the ages of fifteen to eighteen, the idiot grade ceasing develop¬ 
ment about three years earlier than the borderline grade, 

"3, For the cases figuring in the present study and for the 
time period they were under observation, 4.8 per eont of the 
cases gained twelve moritha or more in mental age in a year, 68 
per cent gain from' one to eleven months a year, 11 per cent 
gain or lose less than one month a year, and IG per cent los^ 
from one to seven months a year in mcntnl age, 

"4. The lower grades lose more frequently in mental age than 
the higher grades. 

"B. The frequency in loss in mental age increases with age, 
independently of grade."* 

Doll says on the I’ato of growth for subnormals: "Not much 
more is known about the rate of mental growth among extreme 
subnormals, like the feeble-minded, than about the age of nh'est, 
In this regard we are even at a loss for adequate observational 
data. Experience with institutional feeble-minded, however, sug¬ 
gests a great variety of possible forms of retardation curves. 
Such experience points to a small but signiticatit group of feeble¬ 
minded who grade ‘at age’ by the Binet scale when first ex¬ 
amined but who make no material progress in later examinations 
over a period of years (Type A.) There are others (Type D) who 
nt the tirrie of first examination test at ngo, then continue to 
develop at a retarded rata for a time and then reach a point of 
arrest, There is a third group (Type C) already retarded when 
first observed, who from the first examination to tlie age of final 
arrest develop at an annual rate of growth which is a con¬ 
stantly decreasing variable. There is also a fourth group (Type 
,D) who from the time of first examination to the age of final 
arrest. There are many variants and combinations ,bf these 
basic types for individual subjects. We believe, however, that 
these four types comprise the majority of the feeble-minded. It 
is conceivable, though not probable, that some individuals might 
have a higlier than average rate before retarding. It is also con¬ 
ceivable, though not likely, that the arrest might be relatively 
greater in the early ages with a curve of growth which would be 
accelerating at some intervals. It -remains for experimcTital in¬ 
vestigation to show the relative frequencies of these different 
types of growth curves."* 


^Kuhla^nn, IlfflulU of iLcpcaled ne-cxomlnotlons of Feeblo-mlnded (039) 
» Period og Tea Yenrs. Journal of Applied Pey, Sept., 1021. 

Holl, Growth oC lulelUgence. I’ey. MonogTopli, pp,* 15-10 
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"With the view .of determining' what light, if any, the limited 
data on hand could-throw on the Bubject of the growth of intelli¬ 
gence of feeble-minded Bubjecta 100 mental age growth curves 
of pupils attending the Bitiet Schools from three to eight years 
were plotted. These curves were then classified according to 
Doll's theoretical intelligence growth curves as follows: 

Type Ay (Doll) Those Twho teat ”at age” by the Biuet scale 
when first examine^ but make no material progress in later ex¬ 
aminations. 

‘ Type B. (Doll) Those who at the time of first examination test 
“at age,” then continue to develop at a retarded rate for a time 
and then reach a point of arrest. 

Type C- (Doll) Those, who are already retarded at time of 
first examination but who continue to develop from the time of 
first examination until time nf final ain'eat at an annual rate of 
growth which is i constant'j decreasing variable, 

Type D. (Doll) Those who from the time of first examination 
to the age of final arrest develop at a constant rate up to time 
of final arrest. 

For convenience two new types were added although it is quite 
likely they could be easily included in. one of the above groups. 
They are ns follows: 

TypeE, (New) Those who are retarded at the time of first 
examinaticn, and who also have apparently reached tho time of 
final arrest. 

TypeF. (New) Those who have developed at a constant or 
variable rate up to the time of apparent arrest, but who after 
two to four years of apparent arrest, have begun to develop 
again. 

NUMBER OP CASES TYPE 


I ... 4 to 6 

1 . A 

0 .-. B 

47 . C 

22 . D 

II . F 


100 

Of the 11 cases listed as type / there ware 

4 who remained at aa apparent arrest for 2 years, 

fi who remained at an annarent aiTeat for 3 years. 

2 wlio remained at an apparent arrest for 4 years. 
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Of these 11 eases listed ns type f there were 
2 cases who contimied dcvelopraent for 1 year after arrest. 

6 cases who continued development for 2 years after arrest, 

2 cases who continued development for 3 years after arrest, 

1 case who continued development for 4 years after ni'rest. 

at which time there was another apparent arrest or the children 
left school, 

Type / cases classified aecoriling to life age 


Number of Cases Life Age 

1 . 6 to 7 

1 . 7 to 8 

6 . 9 to 10, 

1 . 10 to 11 

2 . 11 to 12 

1 . 12 to IS 

11 

Type / cases classified accoi'ding to mental age 

Numhfer of Cases Mental Age 

2 . 3 to 4' 

6 . G to 7 

1 . 7 to 8 


11 


SUMMARY. 

1. It is evident that a greater number (47) of the cases studied 
in this group have developed mentally according to Doll's theo¬ 
retical curve described as Type C. 

2. The next larger group (22) of cases studied have developed 
mentally according to Doll’s theoretical curve described as Type D. 

3. There wei’e 67 cases out of the 100 studied who were re¬ 
tarded when first examined and who then retarded either at a 
constant rate or at a steadily decreasing rate up to age of final 
arrest. 

4. Only one (1) case could be obviously classified under 
Type A. 

5. The 19 cases which were retarded when first examined and 
which developed no further at later examinations may or may 
not belong to Type A.That is, it is possible that if they had been 
examined at earlier periods they would have tested “at age,” 
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6, The 11 cases under Type P could be clasalflod under Type 
C in n brond clflSBificQtion. They differ from*that type merely 
in the fact of having long periods of arrest but in the long run 
they develop nt a decrenBing rate up to the UmQ of final arrest. 

T. It would appear fron the study of these 100 cases that 
the majority 80 in this study of feeble-minded caseB slow up 
frndually in mentality up to time of final arrest and that com¬ 
paratively few develop norninlly for a time and then stop sud¬ 
denly. In thi.'? study not more than 20 of the cases could have 
been said to have come to sudden arrest and 19 out of the 20 
cases are doubtful. 

8, The 100 cases studied were all classified as feeble-minded 
and were attending Binet Schools. It is po.saiblo tliat feeble- 
minded cases which develop normally and then retard suddenly 
are not diacoverecl early enough in their school careera to be 
selected for Dinot Schools. 

P>MiT II. Study jn Some Values of tjie I. Q. 

Prom three to seven testa were made on 200 children attending 
the Binet Schools at intervals of a year in most cases. There 
are cases which are noted in which the retests were made nt 
greater intervals because the children were no^ available for 
examination either because they hud moved fi'om. the city or 
attended another school and then re-entered the Binet School 
when they were re-oxaminod. At the time of this study there 
were only two hundred cases who had been re-examined n suffi¬ 
cient number of times to mnke the study of their cases worth 
while. These cases then were all selected because they were 
attending the Binet Schools and because they had attended long 
enough to have from two to six retests made nt intervals of a 
year. 

The cases were classified and grouped. 

(a) According to life age at initial test and- I. Q. in groups 
of tens. 

(b) , According.to I. Q. in groups of tens, 

(c) According to I. Q. and intervale of retests regardless of 
life -age. 

These groupings were made in order to study the I. Q. in its 
various aspects, 
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A. CASKS CKASSIFIKD ACCOIIDINO TO LIFB AGK AT INITIAL TKST 
AND I Q-IN GIIOUDS Ol’ TENS. 


No. of Cases. 

Life Age. 

Median I, 

at 

First Test. 

Q. Numi>ci’ 
of 

Retests. 

Median I. Q. 
all 

Last Tost, 

0 

C 




2 

7 

38^ 

7 

■dlVa 

1 

8 

39 

6 

41 

1 

9 

33 

4 

44 

2 

10 

31 

4 

26 

0 

IX 




0 

12 




1 

13 

3G 

4 

23 


7 


1 

6 

44 

6 

42 

0 

7 




3 

S 

42 

G 

44 

3 

9 

47 

4 

47 

0 

10 




2 

11 

44 

3 

48 

1 

12 

49 

6 

40 

0 

13 





10 


3 

G 

66 

4 

44 

1 

7 

68 

6 

58 

3 

6 

69 

5 

56 

7 

9 

64 

3 

49 V2 

4 

10 

63 

3 

61Vi 

6 

11 

54^ 

4 

51 

2 

12 

67 

3 

48% 


26 


0 

6 




1 

7 

69 

3 

67 

3 

8 

61 

4 

63 

16 

3 

67 

6 

67 

6 

10 

67 

4 

68 

8 

11 

64% 

3 

67 

6 

12 

64 

3 

67% 

2 

13 

64 

3 

56 


4P 
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A. CASES CLASSIFIED ACCORDING TO LIFE AGE AT INITIAL TEST 
AND I Q-rIN GROUPS OF TENS. <CONTINOED ) 


No. of Cases. 

Life Age. 

Median 1. Q. 

Number Median I. Q. 



at 

of 

at 


First Te.st. 

Rcte.sts. 

Last Test. 

2’ 

6 

74 

4 

60% 

1 

7 

70 

7 

60 

2 

8 

76 

4 

66 

6 

9 

74 

6 

48 

6 

10 

73‘A 

6 

66% 

8 

11 

73% 

3 

60 

6 

12 

72 

3 

GO 


29 


SUMMARY OF RESULTS. 

,1. The cases with I. Q.'s from 30 to 30, ineJusive, and with life 
ages from six to nine years, inclusive, showed a gain in median 
I, Q. of 2 to 11 points. 

2. The eases with I. Q.'s from 30 to 30, inclusive, and with life 
ages from 10 to 13, inclusive, showed a loss of 6 to 7 points in 
median I. Q. 

3. The eases with I. Q.'s from 40 to 40, inclusive, and with life 
ages of 0 years showed a loss of 2 points in median I. Q, 

4. The cases with I. Q.'s from 40 to 40, inclusive, and with 
life ages from 8 to 11, inclusive, showed n gain in inedion I. Q, 
of 2 to 4 points. 

6. The cases with I. Q.'s from 40 to 40, inclusive, and with the 
life ages of 12 showed a loss in median I. Q. of 5 points. 

fl, The cases with I. Q.'s from 60 to 69, inclusive, and with life 
ages from 6 to 12, inclusive, showed o loss in medinn I. Q. of 
nothing to 9 points. 

7. The cases with I. Q.'s from 60 to 09, inclusive, and with life 
ages from 6 to 13, inclusive, showed a loss in median I. Q, of 7 to 

2. The cases with I. Q.'s between 40 and 49 showed a loss of 1 
12 points. 

8. The cases with I, Q.'s from 70 to 79, inclusive, and with life 
ages from 6 to 12, inclusive, showed a loss in median I, Q, of 10' 
to 26 points. 

9. In other words, the younger cases with I. Q.'s from 30 to 39- 
inclusive, gained in median I. Q.; the older cases with I. Q.’s from 
30 to 39, inclusive, lost in median I. Q. 

10. With the exception of the G-year-olds who lost 2 points in 
median I. Q. the younger cases with I. Q.’s from 40 to 49, inclusive,. 
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gained in median L Q.; tho older caaea with I. Q/a from 40 to 49, 
incluaivfi lost in median I. Q.'s. 

11. All caaea of any ago with I. Q.’s from 60 to 80, incluaivp 
allowed n loss in median !• Q. 

n. CASES CUSSIPIffiD ACCOnDiNG TO iq 
No. of I. Q. Range Median I,Q.'g at Successive Examinations. 


Cases 


1 

2 

3 

4 

B 

6 

14 

30-39 

35 

33 

31 

30 

37 


29 

40-49 

47 

49 

46* 

48 

46 


69 

60-69 

B6 

66 

64 

61’ 

60 

48 

69 

60-69 

G6 

60 

60 

58 

60 

67 

39 

70-79 

73 

67 

62 

60 

56 

56 


SUMMARY. 

1. The cases ivitli I. Q.'s between 30 and 39 showed a g^ain of 2 
points in median 1. Q. at the Bth re-examination, 
point in median I. Q. at the Bth re'examination. 

3, The cases with I. Q.'s between 50 and 69 showed a logs in 
median I. Q. of 3 points at the 6th re-examination. 

4, The c&sea with I. Q.'s bbtween 60 and 69 showed a loss in 
median I. Q. of 8 points at the 6th le-ex&mination. 

6. The cases with I. Q.’s between 70 and 79 showed a loss in 
median I. Q. of 17 points at the 0th re-examinatio'n. 

6. All cajes with I. Q.'g below 60 remained practically sta¬ 
tionary with a gain or loss of but 1 or 2 points in median I, Q. 

7. The cases with I. Q.'s beWcen 70 and 90 showed 'loss. The 
highest initial I. Q, showed the greatest loss in median I. Q. at 
the final ve-examination. 
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c, CASES CLASSIFIKI) Af’COnniNG TO !(} AND ALSO ACCORDING 
TO INTEIIVALK OF ItETFSTH. • 


No. 

of IQ Median IQ’s nt initial test and at intervals of retests 
cases range ComparGd, 




1 

2 

12 

30-39 

34-32’ 


10 

30-39 


33“-28- 

12 

30-39 



9 

30-39 



6 

30-39 



33 

40-49 

40-48 


24 

40-49 


46-46' 

20 

40-‘19 



13 

40-49 



7 




67 

60-59 

50-5G 


64 

60-69 


65-53 

40 

60-59 



19 

50-59 



12 

60-69 



7 

60-69 



74 

60-69 

66-61 


64 

60-69 


66-GO 

43 

60-69 



21 

60-69 



9 

60-69 



ZZ 

70-79 

73-07 


31 

70-79 


73-G2 

26 

70-79 



16 

70-79 



11 

70-79 




3 4 5 G 


34-33 

34-37 

39-42 


.44-48 

44-42 

44-43 


65^-CG= 

55-60 

63’-48 

GG-49 


65-58 

G7-G0 

66-66 


73-Gl 

72-68 

72-56 


SUMMARY. 


All imidliui IQ'b In all rniiccH Hhowcd n loss ns follows: 


Range of IQ. 

Points 

1 

lost 

2 

nt successive examinations. 

3 4 6 6 

30-39 

1 

2 

3 

3 

6 

40-49 

Vs 

1 

2 

2 

4 

60-59 

0 

1 

3 

41/^ 

5 

00-09 

4 

6 

7 

7 

9 

70-79 

G 

B 

11 

14 

16 
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In each groi^P of cases the greater loss in median IQ occurred 
at the end of the fifth examinatihn. 

In each group of cases the gi'eatest loss in median IQ occurred 
in the groups of the higher initial IQ’s. 

CONCLUSIONS. 

1. A great majority of the eases who tire examined ns candi¬ 
dates for the Binct Schools are retarded at the time of first ex¬ 
amination and then retard cither conatantly or at a decreasing 
ratio up to time of fine! &rre^. 

2. Comparatively few of the cases examined as cnndidEites for 
the Binet Schools develop normally up to a certain age of arrest 
and then remain at aireat. 

3. In cases whose Intelligence Quotient is below 50 there is a 
tendency for the median IQ to remain constant or to gain or lose 
slightly. The median IQ shows a gain among tlie younger cases. 

4. All cases wth IQ's between 50 and 80 show a decrease in 
median IQ at any age. The highest initial IQ'a show the greatest 
loss in median IQ after repeated examinations. 

6, In the case of examinations at varying intervals the greatest 
loas in median IQ was at the interval of five years which was the 
last examination for all grades of cases. The greatest loss in 
median IQ was shown by the highest grade of cases. 

6. The IQ is variable in individual cases, 

7. No group of cases showed a marked increase in median IQ. 

8. These conclusions are merely for cases examined as- can.- 
didatea for Binet Classes. It is possible that repeated exammations 
on. all retarded cases in a school system might give different re* 
suits. 



THE DOWNEY WILL-TEMPERAMENT GROUP TEST; 
A FURTHER ANALYSIS OF-ITS RELIABILITY 
AND VALIDITY 


By G. M. UucH and M. C, Del Manzo, 
University of Iowa. 


This paper presents the results of a statistical analysis of the 
scores of one hundred and fovty-aix high school students tested 
with tlie Downey Group Will-Temperament Test. The discussion 
of those results will be divided into four sections in accordance 
with the specific objectives of the investigation. 

I The Reliaiiility of the Test as a Whole 

Since the Downey tests are published in. only a single form the 
usual method of obtaining reliability eocflicicnts by correlating 
equivalent forms is not applicable hero. Moreover, the common 
practice of breaking tests into chance halves for purposes of ob¬ 
taining the self-correlation can only be carried out with certain 
qualifications as to the justice of this method, - In an earlier pa¬ 
per', one of the authors has argued that the correlation of the 
sums of the odd-numbered tests against the sums of the even- 
numbered tests might fnirdy provide an approximation to a valid 
coefficient of reliability. A few-words in explanation of the nature 
of the Downey Will-Temferament Tests will help to make clear 
the limitations of the method of correlating chance halves. 

The scale is composed of twelve separate tests each designed to 
measure one aspect of the total volitional pattern. These are; 

A Speed of Movement (VI-1) 

B Freedom from Load (VI-1^ 2) 

C Flexibility (VIH) 

D Spqed of Decision (I) 

E Motor Impulsion (X) 

F . Self-Confidence (XI). 

G Non-compliance (XII) 

H Finality of Judgment (XIII) 

I Motor Inhibition (VII) 

J Interest in Detail (IX) 

IC Co-ordination of Impulses (V) 

L Volitional Perseveration (VIII-2) 

'Iliieli, G, M,: "A PrcUinluary .SlHily of llic Corrtlntloiis l)ct'vcpii JSnU- 
niiitoH or Volitloiuil TriillH mid lliv UtmiltH from llic Uowufy ’WJll-I’rofU(;«',” 
.to\ir»n\ ot I'KyeiioioBy, IWll, ”>, ITilB-lttl. 
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This arrangement of the twelve traits into throe groups as here 
indicated follows the purpose of the author of the test in that 
traits A to D belong to a common "pattern”; traits E to H belong 
to a second "pattern"; and traits I to L belong to a third "pat¬ 
tern,” The groupings sre intended to throw together the tests 
that are intended to reveal, respectively, three main types of voli¬ 
tional temperaments known, in order, as: 

I "Hair-trigger" organization, or the explosive type of -will de¬ 
scribed by James (Testa A, B, C, and D). 

II “Willful, aggressive pattern" (Tests E, P, G, and H). 
in "Slow, accurate, tenacious type” (Tests I, J, K, and L). 

The grouping and characterizations of the author of the tests 
is adhered to here strictly. 

Since the scale is of the nature of a diagnostic picture m which 
certain groups (the three patterns) of tests can logically yield 
■uniformly higli scores, while other portions can as logically yield 
Very low scores (or at least much lower scores), it follows that the 
total score on the whole scale will have very little meoning. It 
also follows that any attempt to split the total scale into chance 
halves must take cave that equal numbers of tests be taken from 
each of the three. diagnostic patterns in forming such chance 
halves. If this is done properly we would then have two half¬ 
scales; each half-scale being composed of two tests from each of 
tlie three patterns or a total of six tests in each half scale. Such 
chance halves could be made up ip. this particular case in several 
way, viz., (1) the grouping of all of the odd-numbered tests in 
one half-scale and oil, of the even-numbered tests in the other 
half-scale, (2) the grouping of the first two tests o£ every pat¬ 
tern into one of the half-scales and the last two tests of each 
pattern into the other half-scale, or, (3) the grouping of the first 
and, last tests of each pattern into one half-scale and the second 
and third tests of each pattern into the second half-scale. 

In the paper mentioned above, the reliability of the Downey 
tests (Individual form) ■was studied only by the first of these three 
methods. In the present report, the reliability coefficients have 
been determined by all of the three possible ways and the results 
averaged, Table 1 shows these results. The notations as "Method 
1," "Method 2," nnd "Method 3” refer to the above-mentioned 
ways of obtaining chance halves. The notation "r mean.i 
that the coefficient of correlation stated was obtained by correlat¬ 
ing half (six tests) of the scale with the remaining half (six 
tests) of the scale. The notation "rn" is the porphecied correla¬ 
tion ■which "would be obtained if two similar whole forma were cor¬ 
related. The values of the "rji” column were calculated by the 
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use of BroAVti's formula, n r 

t=- The jiges of the 

H-(n-l) r 

subjects cover n range of from ten to twenty-nine years. Grades 
seven to twelve are involved. 


TABLE 1 


IlKrilAIlILITr COllirPICIENTS 


Method 

r y 

Tu 

(Brown’s formula) 

N 

I 

0.17 

0.29 

14G 

II 

0.31 

0.47 

146 

III 

0.24 

0.38 

146 

Average 

0.24 

0.38 

UG 


The probable errors of these coefficients (Penrson product-mo¬ 
ment formula) range between O.OB and 0.06. Table 7 shows the 
probable errors of coefficients of correlation for the various values 
of r reported in this study. 

In view of tlie wide range of talent represented in the group 
tested, these reliability coefficients cannot be considered to be very 
satisfactory. They are, however, much higher than those pub¬ 
lished in the eai'licr paper cited; the range of talent in tl\e former 
group being very much more curtailed. 

There is another possibility which must be considered in accept¬ 
ing these reliability coefficients at their face value. According to 
our original assumptions, the reliability of the scale as a wliolo 
can only be obtained by the methods we have used in case the 
testa are correctly Qroit-ped into patterns in a proper manner. The 
low reliability which we have found might mean merely that the 
tests are improperly clasaiffed at present. In this case, the true 
reliability of the scale (properly arranged) might be markedly 
higher than we have reported. Discussion,of this question of the 
grouping of the separate testa should be postponed until the inter- 
correlations of the tests have been presented. 

II The Internal Coherence of the Scale 

One of the crucial issues in the evaluation of the Will-Tempera- 
ment Test is the matter of the arrangement of the separate ele¬ 
ments into the diagnostic patterns. As the authors interpret Dr. 
Downey’s classification of the individual tests into groups which 
picture volitional patterns, it would seem that a valid grouping 
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would imply certain mutual relationships among the teats. Those 
Rve; 

(1) High scores in one teat of a pattern would be paralleled with, 
high scores in the other three tests of the same pattern. This 
is equivalent to saying that the inter-corrclationa between, 
tests of a given pattei’n wouW tend to be positive nud high. 

(2) Correlations between each test and the composites of the- 
testa of the game pattern would tend to be positive and high. 

(3) The correlations between tests of one pattern' and those of 
the other patterns would tend to be zero or very low. 

(4) Correlations between single teats and the total score on the 
scale would be low in all probability and not significant for 
purposes of evaluating the teats. 

In order to test these assumptions about the proper grouping- 
of the teats of the present scale, the correlations of each test with 
the composite (sum) of the other tliree tests of the same pattern 
have been computed. For obvious reasons the test used as one of 
the variables in the correlation must be omitted from the com- 
pdsite. Table 2 shows the obtained correlations. 

TABLE 2 

corhelations op the tests iv^th the compo.sites 


Test 

Composite 

r 

A 

B+C+D 

0.54 

B 

A+C+D 

0.28 

C 

A+B+D 

0.10 

D 

A+B-t-G 

0,39 

E 

F-hG+H 

-0.08 

F 

E+G+H 

-0.23 

G 

I+P+H 

-0.13 

H 

E-hF+G 

-0.09 

I 

J+K+L 

0.07 

J 

I+K+L 

0.33 

K 

l+J+E 

0.07 

L 

I+J+K 

0.06 


The average inter-correlations of the tests within a pattern is; 
probably even a better method of testing the general validity of 
the grouping into patterns. Table 9 shows the results yielded by 
this method. 
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TABLE 3 

iXTrni-conuKLAi'ioNs ok tiijs tests ok the same i’Attiorns 


Vtiri(]ble 7 Variable 2 r 

A B 0.30 

A C 0.28 

A D 0.37 

■B C -0.05 

D D 0.33 

G D 0.05 

Averuye 0.22 

E F -0,05 

E G 0.00 

E H -0.02 

F G -0,16 

F H -0.15 

G H 0.01 

Averaffi -O.OG 

I J 0.08 

I IC 0.12 

I L 0.00 

J K 0.24 

J L 0.18 

K L -0.18 

Average 0.07 


G<jnernl inspection of Tnbles 2 and 3 ahowa that the correlations 
between the separate tests are uniformly low, the second pattern 
(Testa E to H) being the moat unsatisfactory. It would be inter¬ 
esting to pick out from each pattern the best tests if this could be 
dons easily. This would properly be done by multiple correlation 
methods and the labor involved would not seem to be justified by 
the general promise of the coefficients reported. In pattern one, 
it would appear that Testa A and .D would probably bo found to 
be considerably superior to the other two. In pattern two, there 
is no promise that multiple correlation methods would reveal any-: 
thing of aignifi<;nncB. , In pattern threOj Teats, J- and IC would ap¬ 
pear the most promising. 
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III Correlation of the Will Traits Wit?i General 
Intelligence 

Table 4 shows the correlations obtained between the scores in 
the twelve separate will tests and the averages of two standard 
group tests. The latter are the Terman Gvoxip Teat of Mental 
Ability and the Morgan Group Mental Teat. The reliabilities of 
each of these tests is known to be well above 0.90 for ranges of 
talent comparable with those represented in the group considered 
here. The significance of the coefficients of correlations of Table 
4, like those of nil of the preceding tables, is obscured by the 
fact that the reliabilities of the separate tests are unknown and. 
are probably very low in many cases. 


TABLE 4 


CORinaLATlONS OP 'CHE TWELVE WILL TRAITS WITH MEASURES 
OF GENERAL INTELLIGBNCK 


Test 

A 

B 

C 

D 


0.40 

0.19 

0.20 

0.16 


E 

F 

G 

H 


-0.03 

0.20 

0.11 

0,14 


I 

J 

K 

L 


0.15 

0.33 

0.34 

-0.06 


None of the above correlations is high enough to lend any sup¬ 
port to the possible criticism of the Downey tests as being meas¬ 
ures of general intelligence. The factor of intelligence midoubt- 
edly does enter into some of the teats but not to an extent that 
would invalidate the scale on this score. 

The inter-correlations between the tests have also been deter¬ 
mined independently of the influence of intelligence by means of the 
usual methods of partial correlation. Table B shows such partial 
coefficients. The notations “rAB.i", "rAC.i", etc., read; The cor¬ 
relation between traits A and B which is Independent of the in¬ 
fluence of intelligence, and similarly, for the correlation between 
traits A and C, and the others. 
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TABLE 5 

TIII3 rORRULATIONa lUSTWERN TUB SEPARATE TRAITS WIIICH 
EXISTS INDIOPHNDIONTl.Y OR TUB RACTOIl OE INTERLiaENCB 
(OIITAINKI) BY PARTIAL CORlllOLATIONS) 


r r . r 


AB.i 

0.33 

EP.i 

-0.04 

IJ.i 

0.03 

r 


r 


r 


AC.i 

0.22 

EG.i 

0.00 

IlC.i 

0.07 

r 


r 


r 


AD.i 

0.34 

EH.i 

-0.02 

IL.i 

0.01 

T 


r 


r 


BCA 

-0.00 

PG.i 

-0.17 

JK.i 

0.14 

r 


r 


r 


BD.i 

0.31 

PH.i 

-0.10 

JLfi 

0.21 

r 


r 


r 


CD.i 

0.02 

GH.i 

0.00 

KL.i 

-0.18 


By referring to Table 4 again it will be seen that there has been 
little change resulting from the use of partial correlations in elim¬ 
inating the influence of the factor of intelligence. It may be con¬ 
cluded that whatever inter-corrclation docs exists between the 
various separate tests of the aame patterns is not produced by 
the common factor of intelligence. The formula used in partial 
correlation is the usual one, following Yule’s'notations: 

r — r r 

T 12 13 23 

i2.a = ■ — -■ -- 

I 2 i 2 

\ "'w M '"23 

IV The Validity of the Downey Scale 

The validation of any test of. psychology capacities is at best 
a most difficult task. To this rule the Downey scale is probably 
no exception. For an account of the derivation of these tests the 
render is referred to the manual for use with the Win-Tempera¬ 
ment Scale*. 

In the earlier paper to which reference has several times been 
made, it was attempted to secure rotings' from competent judges 
acquainted with the subjects'on each of the twelve traits of the 
Downey scale, A similar procedure has been adopted in the pres¬ 
ent study vnth certain modifications. It was thought that the 
teachers of the high school .pupils under study might be able to 
furnish a set of ratings on .the twelve traits which would have 

“Downey, June 10: "The WIH-Profllc.” University of Wyoming Bulletin, 
Vol XVI, No, 4b. NoveiDbor, 1010. 
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value as a criterion against which to evniiiatc the tests proper. In 
adopting tEiis plan, the authors were by no means ignorant of the 
many pitfalls in subjective judgments. As shown in certain 
of the piiblishecl studies, it is possible, at times, with sufikiont 
core, to obtain reliable subjective osLimnLcs in the sense of high 
self-correlation among the judges. However, high reliability, al¬ 
though admittedly highly desirable for .siicli i)iirpo.sc.s, doe.s not 
guavantoe that a valid evitevion has been built up. The question 
of the validity of such criteria is by fnv the more .serious issue. 
The fact that ten persons rating a group of individuals for ‘'ini¬ 
tiative," "leadership,” or "tact" agree with a reliability equal to 
0.75 or higher means merely that tliey are rating the same thing 
or some other thing highly correlated with this thing, but it: does 
not follow of necessity that the ratings correspond to the psycho¬ 
logical functions vvliich by hypothesis underlie the thing being 
rated. Teachers can furnish ratings on their pupils upon such 
traits as "persistence," "conscientiousness," ‘‘originality," "hon¬ 
esty," and a host of other trails with a fair amount of reliability, 
yet careful statistical analysis will reveal that little else is in¬ 
volved in these various separate trait ratings than the teachers’ 
general estimates of the quality of school work being done by these 
pupils.. In other words, almost as good results could bo obtained 
by asking for estimotes of school work and then using these, in 
turn, as estimates of "persistence," "oviginality," "conscicutious- 
nesa," etc. The estimates, then, are clearly not valid except as 
these traits are genuinely correlated with the quality of school 
work and even then it is a very indirect type of measurement. 

On the other hand what conclusions can be drawn from the 
situation of judges not being able to agree upon the presence ox 
absence of quantitative statement of psychological traits in a 
group of individuals known to the judges? Does failure to show 
self-correlation in chance halves of the.se sets of estimates carry 
with it any important implication? Docs such a negative result 
with respect to a psychological trait prove that the trait in ques¬ 
tion has no true psychological basis? No universal answer can be 
given to these queries. In the case of many reputed psychological 
rubrics U probably does mean that there is no real evidence for 
assuming the reality of. such traits as true mental functions. In 
other cases if not in most the answer is left in an undeterminate 
status, i.e., the experimental results are entirely non-committal in 
the sense that they furnish no evidence; positive or negative, upon 
the issue of the existence or non-existence of bho trait in question. 
Even at this it might for all practical purposes be argued thot 
unless competent persons are in fair agreement about the presence 
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■or absence of reputed psychological characteinstics there is no 
direct way of identifyijjg such traits for purposes of study. 

With these limitations of the method of osLimaLo.H in mind wo 
can return to the di.scussion of the iinmodiato problem. In the 
attempt to build up a criterion for purposes of correlation of the 
trait scores with n second measure of the .same traits the liigh 
school teacliers of the jmpils in oiir prc.sent .study were o.skod 
simply to noininutc the ten pupil.s In their classes who pos.ses.sejl 
the "strongest will-power” and the ton who had the ''weakest will¬ 
power,” No attempt at further dcrinition of these directions was 
made. The reactions expected were Lho.se of the man on the street, 
The only outcome which was expected was that the pooled nomi¬ 
nations might reveal two groups widely spaced u]3on a scale of 
"will-power” in tlie common meaning of that term. When the 
nomination b]nnk.s wore received it was found that certain pupils 
were invariably reported in the game category. A larger number 
were about aa often placed in one group as the other and a still 
larger number were never once nominated for either classification, 
There was, then, evidence of marked agreement in many cases, 
the total number of complete agreements being roughly 20 per 
cent of the total of one hundred forty-six pupils in the high school 
under study. Twenty-eight pupils involving equal Jiumbers of the 
sexes and equal number,s in each of tlm two categories (i.e., "strong- 
willed” and "weak-willed") were selected for further study. The 
•agreement was perfect or practically perfect in these cases in the 
sense that either three or four of the four teachers acquainted 
with every pupil placed him in the same category and no teacher 
.gave a dissenting vote in any of these cases. The reliability coeffl- 
'Cient fox this final group was not determined but its general na¬ 
ture is assuredly high by virtue of the method of forming the group. 
Instructions were then sent to every teacher who had nominated 
any of the pupils in the final group to rate each pupil upon each 
of the twelve traits of the Downey scale. The trait descriptions 
were taken verbatim from the author's manual for use with these 
'.testa. 

The firtfll group therefore comprised (to the best knowledge of 
all of the teachers of the school) the fourteen pupils of the school 
showing the most marked volitional characteristics and an equal 
number most lacking in these same characteristics. As well as 
eould be done by estimation we had segregated the highest and 
lowest t6n per cents-of the group ns a whole. Table G shows the 
correlations found between the pooled estimates of the teachers 
and the teat scores in each of the twelve traits. Inspection of 
these coefficients of correlation does not reveal very definite evi¬ 
dence of the ability of teochers to identify the various traits tested 
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by the Downey scale. Whether this situation can be interpreted' 
as meaning tliat the Downey scale is of doubtful validity is very 
questionable. A eaner conclusion would be that tcachci‘3 are un¬ 
able to identify the traits of the Downey scale in their pupils to 
any considerable extent (traits J and K, and possibly traits A 
and C being apparent exceptions). It ia probably fnir to assume,, 
however, that the Downey tests cannot be validated by the method 
of subjective estimates with sny high amount of nssiiranco. The 
correlations between estimates and test scores are in general of 
about the same magnitudes as those reported in the earlier study 
(where the range was from -0.33 to 0.61 for the pooled estimates 
of three or four college profeasors; the average being 0.07). The 
average estimate-test correlation ia 0.15 for Table 6. 

TABLE 6 

COnilBLATIONS HI3TWJ5BN BSTIMATES AND TEST SCORES (N=2fl) 


Trait 

r 

Trait 

r 

Trait 

r 

A 

0.37 

E 

0.19 

I 

-0.09 ‘ 

B 

0.02 

P 

-0.03 

J 

0.61 

C 

0.30 

G 

-Q.04 

IC 

0.63 

D 

-0.20 

H 

0.17 

L 

0,17 


The probable errors of the coefficients of correlation in Table 6’ 
can be found in Table 7 to a'sufficient accuracy for our purposes. 
The same ia true of the correlation coefficients given in Tables 1 
to B. Except in Table 6, the numbers of cases have invariably been 
one hundred and forty-six. 


TABLE 7 

A HEFKRENCE table of probable errors of PEAIISON ro- 
EFFICIENTS OP CORKBLATION FOR VALUES OP r 
APPEARING IN THE FOREGOING TABLES 


r Probable Erors of r 



N=146 

M=28 

0.00 

.056 

.127 

0,05 

.056 

.127 

0.10 

.065 

.126 

0.16 

.06E 

.125 

0.20 

.054 

.122 

0.25 

.052 

.120 

0.30 

.051 

.116 

0.36 

.049 

.112 

0.40 

.047 

.107, 

0.46 

.045 

,102 

0.50 

.042 

.096 

0165 

.038 

.089 
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CONCLUSIONS. 

The following points ni’e suggested as summarizing the more im¬ 
portant findings presented: 

(1) The reliability of the Downey Grotiy IViH-remjjcrttitieitt Teui 
is probably not higher than 0,40 ns nn estimate of the corre¬ 
lation which would be found between two similar forms of the 
tests were n second form available. It is no doubt true that 
certain of the piitterns arc more reliable than others, a fact 
which militates against the reliability of the scale as a whole. 

(2) The validity of certain of the individual tests is doubtful. The 
inter-correlationa in patterns II and III are low, pattern I 
being the most satisfactory, The some situation holds for 
the correlations of the individual tests with the composites of 
the remaining tests of the same pattern. 

(3) The lack of inter-correlation between tests of the same pat¬ 
tern in the case of pattern II, and to a less degree in the 
other patterns, may be due to either: (a) unreliability of the 
individual testa (not determined in this study), or (b) faulty 
location of cerhiin tests. In the latter case further study 
might suggest changes from one pattern into onotber. 

(4) There was found no reason to believe that the Downey tests 
measure merely intelligence. The inter-correlations, where 
they are significnlly high, arc not due to the common factor 
of intelligence. 

(6) The attempt to validate the separate tests of the scale by 
means of teachers’ judgments yielded ambiguous results. It 
would appear that strict validation of the Downey tests by the 
method of estimates would be a very difficult task. We can 
conclude that, with a few exceptions, high school teachers 
cannot identify the psychological traits measured by the 
Downey teats by study of the characterizations of those traits 
which have been published by the author of the tests. It 
should be pointed out that the estimates used in. this study 
cannot be assumed to be valid, although their general relia¬ 
bility is doubtless satisfactorily high for purposes of a rough 
criterion. The question of the validation of the Downey tests 
can better be dismissed by refering the reader to Dr. Downey’s 
manual, previously cited, for a discussion of this point. 

(G).Iti general there are a considerable number of testa in the 
Downey Will-Tcm2}eraine7it Teat that show promise of lending 
themselves to further study and development, Duplication of 
such tests and probably n number of substitutions will lead to 
n more valid instrument for the measurement of volitional 
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traita. The urgent need for such mensurements demands tlni- 
the pioneer efforts of Dr. Downey be rewarded witli the rec 
ogmtion that much promising ground had been broken bv h.r 
investigatoB aad that fuj-ther proereas ha/beap 
made possible in this direction. 



the FRESHMAN: THORNDIKE COLLEGE EN¬ 
TRANCE TESTS, FIRST SEMESTER 
GRADES, BINET TESTS 


By W. T. Root, 
Univorsily of Piltsbiu'g^h. 


fMTROfidCTlON, At the bcginiuiif' of the aciicieinic yonv, 
1921*22, tln! Cfilkif'c of Iho University of PittHbuvgh* gnve the' 
Thovndihe Intolligence Exuiniiiiitioii for High School Graduates 
to n Freshman class of r>f>b. The tests given wcrei Part I, Form 
I (designated aa Tl) ; Part I, Form M (T2) ; Part II, Form D 
(TS); Part III, Form D (Td). The total, that is the sum of the 
lour tests, is designated Tr>. The test v/na given without inter¬ 
mission other than the short intervals provided for in the in- 
slvuctions. 


Results. Tlic following nvernges were secured: 



Tost 

Average 



Tl 

105,119 



T2 

105.276 



TA 

101.604 



T4 

32.97 



Tf> 

341.61 


Final score 

(Tfi divided by 6) 

G8.38 


Median scor 

c. 70 



Range 21 to 

no 



Corrc/«tio7ta 

hetween different 

forms. The forma 'were correlated’ 

with the total 

singly and in combination: 


Test 

r (Pearson) 

P. E. 

T5 

with Tl 

.848 

.007 

T5 

with T2 

.829 

.009 

T5 

with T3 

.904 

.006 

T5 

with T4 

.754 

.01 

T6 

with Tl phis TZ 

.914 

.004 

T6 

with Tl plus T3 

.900 

.002 


•Tin* Di'piirtiiu'nt of VByrliolocy gave iind Kcumi lIiR tpats. Tlif -writer 
lb Indebtod to llu- KnnUmle BtndontH In pHycholoeJ’ for miiny weary lioiirs 
of uluLinLlciil ciileiiliUloii. Kpoclnl iickubwledgmunt la due L'rofoBsor I’lcrence 
M, Teiigiirden fiiv IriinHimillnp gnulos Into slginii vnlncn nml for giving the 
lllnet 'i’l'bt.s to ilic FrcHhmen glrl.s. AIvh. Itlu Nyce Utiot 1 b to ho thanlted for 
miiny iliiyw KiioiiL ]ji the vexiillona liiHk of KtnUHlltnl rcchcclilng niul ot 
fcrvolliig out orrorH. 
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The high corrc^attoii Tt plus Ts with T5 auggeBls vevy 
strongly that TH and 6e dimhated in /uturc teaiing. TMs 
‘Would mean a great economy in the time required to give the test, 
■in the time required to score, and in the cost o/'tost 7nate')'ia-ls. 

Correlation of T6 'loiih the academic grades for the first semes¬ 
ter. lu attempting to summate the academic gradea the writer 
met with the usual dilflcultiea, It seemed best after ull factors 
were considered to resort to the tedious method of transmuting all 
grades to sigma values thus correcting for the great variance in 
distribution of A's, B's, C's, D'a, and P’s. The sigma value was 
weighted according to the number of units of credit the course in 
question carried. The weighted sigma values were added and 
divided by the number of units of credit carried by the particular 
Freshman in question. This procedure overcomes the injustice 
usually experienced by students carrying “stiff” courses (i.e., 
courses with a high percentage of D’s and P’s and a low per¬ 
centage of A’s and B’s). Tlie sigma values of A, B, C, D, and P 
were determined for each subject taught to Freshmen. D is the 
lowest passing grade while F is failure. 

The correlations between the academic gi'ades and the Thorn- 
■ dihe forms are as follows: 


Test 


r 

P.E. 

T1 

with grades 

,42 

,02 

T2 

with grades 

.33 

.03 

T3 

with grades 

.36 

.03 

T4 

with grades 

.415 

.02 

T5 

with grades 

.61 

.02 


The Thorndike total was now correlated with each college sub¬ 
ject taken by the Freshmen, debarring a few in which the number 
of beginning students waa too small to admit of correlation. (Tab¬ 
ulation I) 



Academic College Subjects: Grade Percentages, Sigma Values and Correlations With Thorndike 

Entrance Tests. 
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The correlations are ynoderntely hiffh and considerable aignifi- 
eanca aa N is large in the majority of cases and the group is 
homogeneous. The correlation of the Thorndike -test wth Human 
Progress is conspicuously high (r. .089) with a very small prob¬ 
able error (P. E, .01). This couiae deals -with a large number 
of the arts and sciences in a semi-philosophical way. The classes 
are large ami a premium ia placed on general information and 
linguistic ability. English 1, Graphics 2, Mathematics 21 and 
French 1 correlated less highly than the other courses with the 
Thorndike total- English may be a matter of home conditions, 
foreign parentage or drill and follow up work through four years 
of high school. The students enter Graphics and Mathematics with 
very different preparations’; French may be very easy for the stu¬ 
dent with a fair knowledge of Latin or one of the Latin languages. 
If Italian is spoken in the home it may prove to be a hindernnce 
in an English course and a boon in a French course. One may 
speculate indefinitely as to the general causes for correlation or 
non-correlation. 

The ‘prognostic value of tke Thorndike College Entrcnce Testa. 
It is possible to have reasonably high correlations without much 
justification for applying the findings to nn individual case. Dis¬ 
tinct sets of causes may he at' work: thus, we may have nearly 
perfect correlation with a portion of the cases, a moderately posi¬ 
tive trend for a large median group, with a significant group shoVv- 
ing a negative correlation. Again, we may have marked negative 
or positive correlation in certain regions of the data with an in¬ 
different correspondence in other regiona. It becomes pertinent, 
then, to ask for an analyeiA of the tendency to correlation or rank- 
correspondence as well aa to compute the coefficient of correlation. 

The chief reason for administering the tests now under consid- 
.eration to Freshmen ia to predict their capabilities in connection 
with academic college requirements. It therefore seemed desirable 
to rate the Freshmen in some form of grade claasification, ar¬ 
ranged in rank-order, and to compare this ranking with the Thorn¬ 
dike rank-orders, The conventional dis^ibution of grades over a 
±3«i normal distribution curve is, perhaps, as good as any. The 
data can then be tabulated as fonows (A, B, C, D and F referring 
to grades and a, and e referring to. precisely the same per¬ 
cental divisions in the descending rank-order arrangement of tin 
Thorndike totals) : 


A or a 

B orfl 

C or 7 

D or 6 

F or e 

3.6 

24 

45 

24 

3.6 

20 

137 

265 

137 

20 


% . 

No; cases. 
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The college grades are expressed as sigma values and each Fresh- 
mnn's rnnk-ordcr is determined by Hncliiig his average sigma (the 
sum of his weighted sigmas divided by the number of units car¬ 
ried), Those average sigma values arranged in descending rank- 
order arc then i-eady for comparison with the corresponding rank- 
orders in tlie Thorndike tests. If the Thorndike Lost i.s prognostic 
of ncndemic ability then the 20 students compo.sing the A group 
should have a riuik-eorrespondence such os to place the majority of 
them ill the « group (tlie 20 ranking highc.st in the Tlioriuliko 
group). Tabulfition II i>re.sent.s the raiik-oi-dei'.s for college grade.s 
tmcl Thorndike scores for comparison and analy.sia of the rank- 
correspondence in dilTerenl percontnl regions of the rank-order 
acrlcg, The question is: Does the Thorndike Test performance 
anticipate the quality or approximate quality of college work a 
particular Freshnuiii will do? 


TABULATION II. 


■ 

a 

B 

c 

-1 

D 

B 

TOTALS 

A 

□ 

9 

£ 

7 

e 

0 

5 



B 

7 

a 

60 

54 

81 


5 

B 


r 

8 

0 


115 

»a 

65 

ei 

5 

8 

255 

B 

1 

5 

6 

3^ 

70 

61 

53 

33 

B 

137 

B 

0 

1 

0 

5 

9 

9 

8 

5 

3 

i 

20 

\ 

20 

137 

255 

137 

20 







































82 


ROOT 


The‘following observntioiis may be made directly from the tab- 
ulated data: 

1. No. tt’s are ranked D or F in academic atnnding, 

2. No. a's attain A or B standing. 

3. But of those making A standing, only 1/fi cire a’a and the 
largest number are drawn from the 7 group. 

4. Had superior scholarship been predicted by selecting the 
a group we would nctnally have secured 4 A students along with 
9 B stxidents and 7 C students. 

6 , 80 of the 1B7 students comprising the A and B groups aro 
in the a and p group.?. 

Seventy-one of the 1B7 comprising the D and F groups are itj 
the 3 and e groups. 

That is, the upper 27.6% of the Thorndike rank-order.s would 
have been somewhat selective as regards academic attainment. 
Had the e group been taken as a basis of entrance exclusion, it 
would have resulted in the excluding of 8 D students and 9 G 
students out of a total of 20 c students. 

6 . Had the college wished to maintain very high standards and 
had excluded 8 and e standings, it -would have excluded 79 C 
students, 6 B students, and 1 -A student out of a total of 167 
Freshmen. The Thorndike ranlring -would have correctly placed 
71 (that is 5-e’s who are in corresponding academic rank-orders, 
namely the D-F groups), -while random choice alone would have 
correctly placed 44 of these. 

7. On the other hand, if the a-j 3-7 groups had been used as a 
basis of initial retention in college, 86 D and P students would 
have been admitted into the Freshman class against the 71 D and 
F students excluded in the 6 -e's exclusion. Chanco alone would 
have given us 114 D and F grade Freshmen, out of a total of 
410 o-j3-7’s. 

Of the 669 students chance alone would have given 157 DF’s. 
Had the S-s groups been arbitrarily excluded (and the 
gvqups retained), 71 D-F students would have been excluded and 
86 D-F included. But 86 A-B-C stude-nts would have been thus 
excluded. This would give a total of 176 improper inclusions and 
improper exclusions or 19 more than the improper inclusions 
chance alone would have given. 

8 . There are five comparable groups, a-A, ^-B, 7 -C, 8 -D, and 
<-F. Of these groups, the 7 -C is the only one that is largest for 
the column i-n question. In this case it is totally without prog¬ 
nostic significance as chance alone would have placed 115 C’s in 
the 7 group. It should furthermore be noted that the distribution 
of C students through (3, J, 7 and e is about the distribution 
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chtince would have pivcn. And likewise the row has n close-to- 
chtince distribution through A, B, C, D nnd F. Hence for a stu¬ 
dent to be in the 7 group nrgucs nothing db to his ncademic rank- 
order; nnd vice versa, C grades run the gamut of a near-chance 
distribution curve from a to e. 

Deducting from ouch of the five comparable groups (A-«, D-^J, 
etc,) the number of cases that would fall in these groups by 
chnnee alone, gives the number of cases precisely located in a 
corresponding rank-order. Wo have; 

Of 20 ii’s, 3 A’s or 15% in precise corresponding rank-order. 

Of 137 P'a, 27 13’a or 19% in precise corresponding rank-order. 

Of 26B 7 ’a, none. 

Of 137 e's, 20 or 1G% in precise corresponding i-ank-ordor. 

Of 20 e's, 2 or 10% in precise corresponding rank-order. 

9, Compiling ft, y nnd 6 we have 529 coses, comprising 128 B's, 
246 C’s, and 129 D's. Thus the Thorndike testa would have cor¬ 
rectly placed 12 more .subjects thon chnnee alone or about 2 per 
cent of the total number of students in the combined ft, 7 and 5 
groiips. 


TABULATION III. 



B 

B 

D 

B 

B 

B 

D 

B 



i 

B 

D 

B 

B 

B 

B 



1 

a 

B 

B 

B 

B 

B 



B 

IB' 

B 

B 

B 

B 

B 


i 

B 

m 

B 

B 

B 

B 

B 


B 

fl 

B 

B 

B 

B 

B 

B 


AN ANALYSIS OP THORNDIKE'S GROUPINGS 

Thorndike attempts to prophecy on a basis of the absolute 
scores received. He makes the following classification: 

"A boy scoring over 96 is worth admitting in almost entire dis¬ 
regard of technical deficiencies. 

A boy scoring 85 to 96 has intellect enough to do collegiate 
and professional worlc with distinction. 
A boy scoring 70 to 86 has intellect enough to do the work to 
obtain a college degree. 
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A. boy 3corin^ 60 to 70 may be admitted if he is sufficiently 
in earnest and otherwise desirable. 

A. boy scoring 60 to CO should be admitted only if lie is of 
extraordinary zeal or has sulTered 
very great echicational handicaps. 

A boy scoring under 50 should not be admitted." 

The accompanying tabulation (HI) follows Thorndike's group¬ 
ing. The academic grade rank-orders have been arbitrarily 
classified to agree in rank correspondence with the Thorndike 
classification, 

Conclusions; 

1. None of the Thorndike A group falls in the corresponding 
academic group a (the 9 highest academic rank-orders); however, 
none falls in the lowest academic groups, e and f. 

2. Likewise none of the T group falls in the academic a or b 
groups. 

3. The students composing the a group came chiefly from tho 
C group. 

4. Taking Thorndike's G group as the dividing line for in¬ 
clusion in or exclusion from college entrance, one would include 174 
correctly but also 93 incorrectly, (students making d, f, and e 
gi'ndes). On the othei' hand, the elimination of the D, E, and F 
students would have excluded 93 students who are doing work 
in the a, b and c groups, Thus there would be 1’86 improper in¬ 
clusions and exclusions in using Thorndike's A, B and C groups as 
an inclusion basis against 209 proper exclusions. Out of 569 
students 302 would be excluded. It must be recalled that In ex¬ 
cluding such a large percentage of the students seeking admission, 
chance alone would have correctly excluded 161. 

6 . Excluding E’s and F's would retain. 86 of the upper 
Thorndike groups doing no better work than E's and F’s, and 
would exclude 86 E’s and F's doing work on a par with those 
admitted. Granting that e and f grade work warrants exclusion, 
we have 74 proper exclusions, and 170 improper inclusions and 
unjust exclusions, 

6 . Let us take Thorndike's lowest group, F, (scores below 60), 
which Thorndike categorically asserts should be excluded. Of the 
C3 comprising this group 48 do work on a par with many in the 
retained groups, while 48 in the retained groups are doing the 
same quality of academic work as those excluded. Thus we have 
96 improper exclusions and inclusions, and 16 proper exclusions, 
.7, Tabulations II and III lead to the same general conclusions. 
While the coj'relatiou between grades ayid Thorndike scores is 
reasonably high, an inspecliou of the differences w rank-order 
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hulicntsff thni gycnf hiiiHikr. would he done, both 
hi hiclimions (iiid ciri^lumom, vici'r. Ihv fulrfinen teals lined as a 
basis of co(lei/e (iclmiammi. Jii actuaf pmetieo the lines of c/c- 
mfealm belwern f/rouptt tire Ino illy ikfaied to waryant mck 
imlic iiclion (is off-luind e/‘climon from colleyr. IJowever, the 
trend of corrclnlm in Huffincnily sfrtnty lo far nurptm any im¬ 
pressionistic cdiiiJinti; and f/ic /ch/jj nfcoji/d co)i;3ij'/.uft’ «« exoallciU 
iiflSifi for the Initial awlysiH uf rtini'n, and for jndicinns use i)i 
(itlmyiinff lo nizo up hrahicn fnilurcfi. U'/iei/ier the mass test 
I’g iiioj’c truly pvophclk of [mil coUeyc succesfl than the coiiljmed 
estuHdtcg of rfo^c?ifl of iHsIriictors ft/lcr HC}'e?il«cn jy^eb coiiiaci is 
(I sjiectdaiii/e matter lofiich can be decided only by follow-up work 
for a Tiitmbr 0 / ycftn, 


BXTREMK lirmi AND IMWlill ItAXK-DIWim IX CdliLEGR WN- 
TIIANCK TKHTH C(»MI’AU13I) A8 TO PlUiruilMANCM 
IN IIINKT TI'ISTH 

Forty of the upper rank-ordcra of the Thorndike Test (Ito B8 
incluaive) and also 40 of the lower rank-orders (479 to 569 in¬ 
clusive)’ wore given the Binet Tests.* Tile uccempanying 
tabulation (III) shows clearly that the correspondence botwoon the 
two tests ig extremely cloae, quite in contrast to the vague cor¬ 
respondence betweon tlio Thorndiko and the acedejnlc standing. 


'InnbllU}' to nrr/Jiigo n time aiiUablp Tor both the stiidciit nnil the ex- 
fiminci' Rlvlni,' Lite llliiot Test, made it neccRHOry to ^0 below rnnh <10 and 
nliovc milk 521) lu llio lower uroup. One of liie lower rank-orders waa 
ellnilnateil. Tlie aubjeet, an intelligent Itallnn just tenrnlne’ the Miig:ufl?e, 
rGlUBcd to try Llio Illiu't Teat niter dolnK Uie vocabulary, 

'The Htudent appoIjitmcnU for tlio Uinht Tests were arranged through 
the co-opcratlon of ProfeshOr li, P, Anho, Preahnmn Advisor, 



S6 


BOOT 


TABULATION IV 


Binet Teats Used as a Basis for Comparing the Extreme Upper 
and Lower Rank Orders of Thorndike College 
Entrnnce Testa 

40 highest 30 lowest 
Hank Oi'ders Bank Orders 


Ghronological age range... 
Chr'onological age motlinn. 

Mental age range.. 

Mental age median......... 

Vocabulary range..... 

Vocabulary median,... 


22-fi to lO-G 27 to 18-2 
20-1 IS-B 

19-0 to 17-2 18 to 12-1 

13 16-5 

16,860 to 12,780 12,OOOto 0,840 
. 14,940 10,260 


Number failing 

XVni Superior adult voeabulory. 5 SO 

Binet'a paper-cutting test. 26 

Repeats 8 digits. 13 24 

Repeats thought of passage.... 20 

Repeats 7 digits backward. 12 31 

Ingenuity test. 8 31 

XVI Average adult vocabulary. 30 

Interpretation of fables...... llj 

Difference between abstract 

words . 11 

Problem of the enclosed boxes. 5 22 

Repeats 0 digits backwards. 1 11 

Code . 23 

XlV Vocabulary 60 words. 8 

Induction teat . 1 

President and king. 8 

Problems of fact. 10 

Arithnieticol reasoning. D 

Clock . S 

XII Vocabulary 40 words. I 

Abstract words...... 

Ball and field. 4 

DisBcetcd aenteircea. 3 

Fables . 1 

Repeats 5 digits backwards. 8 

Pictures interpretation.. 1 

Gives similarities. 1 

X Vocabulary 30 words,,,,.,,.,,,,., 

Absurdities . 1 


60 words 


2 


Total No. of teats failed......,,..,.-.... 


361 


44 
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The lower (froup is made up of older sludents niul it may be 
added has more of foreign birth and foreign family. It ia a 
ninttcv of general observation that older persons show le.ss as¬ 
sociative pla.sticity and speed. 

Concerning I. Q. and menial age: 

8 of Die Irnvcr gioup had 1. Q.’.^ 100 or more. 

ai of the lower group hud I. Q.’s le.sa than 100, 

3 of tho lower groii2> had mental ugc.s of 12(11-7 to 12-0) 

5 of the lower group hod mental ages of 13(12-7 to 1.3-G) 

4 of the lower group Imd menial ngo.s of 14(13-7 to 14-6) 

8 of the lower group had menial ages of 15(14-7 to 15-G) 

12 of the lowcj- gi'ouiJ had menial ages of 16(15-7 to 16-fi) 

4 of the lower group had menial nges of 17(16-7 Lo 17-C) 

2 of the lower group hod mental uges of 18(17-7 to lfi-6) 

In the upper grouj} the ]o\vc.st I. Q. was 104, Nineteen failed 
in the high tuUilL digits lests; 7 failed in both, 14 passed nil of 
tho test.y; 13 failed 1 teal; 11 failed 2 tests; 1 failed 3 losls; and 
1 failed 5 tests. 

The fact Lluit 25 of tho 44 failures in the upper group were digit 
tests indicates tlial the digit tests (counting an entire year of 
mental ago) arc entirely out of pi’oportion to their importance in 
determining mental ago. A careful study of the individual easea 
gives little evidence that iininediatc verbal auditory memory span 
for digits is of any marked value in tletei’iiiiiiing superior intelli¬ 
gence. It is ii nmlter in which there is marked individual dif¬ 
ference in adults with slight reason for believing that there is n 
corresponding intellectual dilTcrcnce. 

Re(idh}(/ and Vocabulary. The most .striking contra.sts be¬ 
tween the groups is in the vocabulaiies and reading habits. The 
highest vocabulary in the low gwup is less than the poorest vocab¬ 
ulary of the high group. 

An attempt was made to get at the rending habits of the 
groups under consideration, A rough rending scale was impro¬ 
vised, scoring ns follows: 

.1. Headers of critical and difficult literature. 

2. Superior readers, read classical and good current literature. 

3. Average readers. 

4. Readers of newspapers and sport news. 

6, Renders who do almost no voluntary reading being nearly 
devoid of a reading hnbit. 
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Tabulating' for the two groups we have; 


Reading 

Number in 

Number in 

Rank 

High Group 

Low Group 

1. 

.. 6 -.. 

. 1 

2. 

.-.12.-. 

... 2 

3. 

.15.-. 

.-.. 7 

4.-. 

.. 7 ... 

...14 

6.. 

...... 0 . 

..IB 


The contrast here is very marked indicating decided lack of 
reading habits in the lower group. 

TABULATION V. 


Cases With Marked Inconsistency in Performance in Upper and 
Lower Groups 





V 



M 

35 

c 

B 

'Is 

ec 

a 

Q 

iJ 

VI 

.3 

sS 

a 'll 

I115.MAUKS 

A ti 

tp a 

■<ia5 

S n 
fiSai 

% 

W V 


3 

380% 

3 

91 

10 

Out of school 8 yrs, Trig. & Physics 






difficult 

6 

132% 

2 

92 

19 


6 

137 

3 

02 

18 


B 

188% 

1 

86 

18% 

Out of school 3 yrs, Indifferent to 






grades 

10 

197% 

2 

83 

19% 

Exemption grades in H. 8. 

19.B 

188% 

3 

81.5 

19 


20 

297 

1 

87 

19% 



223% 

2 

79 

19 


30 

197 

1 

90% 

19 


36% 

654 

2 

83 

19 

Absent one month in first semester 

36% 

301% 

4 

34 

19% 


40% 

642 

2 

81 

18% 


48% 

360% 

3 

73 

18% 


68% 

258 

4 

89.6 

17-^ 


622 

283 

a 

68 

13-8 

Italian. Foreign parent. 

524 

71 

2 

56 

16-5 

Jewish. Soho district. 

526 

172 

2 

07 

15-8 

Jewish. Foreign parent. 

506% 

290% 

3 

70 

17-1 

Atti&nded sixteen different schools. 

538% 

249 

4 

62 

10 


645% 

267% 

6 

40 

14-9 

Italian. Foreign, home. 

663% 

2G4 

5 

63 

13-11 


664 

208% 

4 

70 

17.-7/ 

Jeivnph- 

667 

167% 

5 

48 

12-2 

Negro. 

661 

20C 

4 

68 

18 

Commutes four hours daily. 
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AnalyBis of cases shawinff marked contrasts in performance. 
It would have been hig-hly dcisirable to have studied the social 
conditions surrounding these Ftoshmcn composing the upper and 
lower groups. This was impossible, due both to lack of time 
and to the diffidence on the part of students concerning their 
social and economic status. Nevertheless, after personal inter¬ 
views with the atudcnts in question, it is possible to throw some 
light on the marked inconsistciicics in test performance and 
academic rank, presented in the nccompanying Tabulation V, 

('ONCI^USIONH 

1. A high Thorndike rank is accompanied by a high Binet 
score and large vocabulary; and vice versa, a low Thorndike score 
by low mental age and small vocabulary. 

2. But high vocabularies are not necessarily found with a 
superior reading ranking or vice versa. 

3. Of the 40 in the upper Thorndike group, 14 are distinctly 
below any corresponding academic rank-order, while 7 fall below 
the median rank-order, 286, of the entire Freshman class, 

4. In the lower group just the opposite is found; with low 
mental age, low vocabulary and low entrance examination score is’ 
found a relatively high academic rank^order. Of the lO cases, 9 
have academic ranks above the median rank-order of the Thorn¬ 
dike scores. 

6 . The cases showing marked inconsistencies constitute nearly 
1-3 of the total number of the 79 cases studied intensively. 

6 . It should also be noted that in spite of exceedingly low vo¬ 
cabulary and mental age, cases 522, BBSli, and 557 make more 
than median grades. 

7. In the lower group, 6 are either Italian or Jewish. In all 
of these cases, and many more not presented here, the parents 
speak a foreign language. Is it not to be expected that an English 
vocabulary and teats resting on the niceties of English idiom 
will suffer ? 

8 . Absence during the semester and a several-year gap be¬ 
tween high school and college seem to be the moat obvious and 
plausible explanations in certain cases of relative academic in¬ 
feriority in the upper group. 

9. The negro, case 557, unlike the Jewish and Itolian lusrs, 
appears very dull. Ho is carrying, .however, a very heavy pro¬ 
gram including mathematics, physics and chemistry in which he 
is making more than median grades. An examination of the per¬ 
centage of A's, B'a, C'a, D's and F's given in these courses indi¬ 
cates that they'are not “pipe courses," (see Tabulation I), In the 
opinion of the writer the explanation is this; The student hos 
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had an excellent high school trnimne -with a careful drilling in 
technical courses that dovetail into the courses taken in college. 

It is doubtful if the chap v^ill long maintain an academic ranking 
of 1B7% Rgninst n Thorndike rank of 557 and a Binot mental 
age of 12-2. 

10. The personal interviews elicited the following, nt least 
plausibie, explanations for the marked rank-order difference be- 
tvveen ocndemic grades and the Thorndike tests: 

(a) Some students arc capable but indifferent to griulca, tend¬ 
ing to follow an interest rather than make punctilious preparation 
of daily tasks, Case 8 is a good example. In the opinion of the 
writer, the Thorndike test places him more nearly correctly. The 
chap has been out of school three years between high school and 
college, which is perhaps a contributing factor, but the chief 
dilhculty is that lie has very positive ideas concerning academic 
values and refuses to fulfill, rvhat he considers to be, petty class¬ 
room demands. He has already been successful in-the work-a-day 
world. 

(b) Outside work, undoubtedly, in mnny cases makes for 
poorer grades. 

(c) Commuting tends, also, to produce a poorer grade of work., 
than otherwise. 

(d) The character of the high school worlc plays o large part 
in the character of the Fvashman college work. For example, one 
high school, gives to its seniors a course on CuiTent Literature. 
All‘of these students show a relatively greater general informa¬ 
tion than the average high school graduate. Another high school 
apparently gives unusual work in science and mathematics, One 
of the students from the lower Thorndike group, with good grades, 
stated that the physics and mathematics he „waa taking were 
almost entirely review. Again, a student changing from a literary 
or a scientific course in high school to a .scientific or literary in 
college is greatly handicepped over the one who hoa had a con¬ 
sent vocational objective. All considered, students who have 
established good habits in mathematics, science, laboratory and 
English composition, regardless of their native endowment, have 
an advantage over those who have not. 

(e) Unusual zeal for learning. and persistence mark the at¬ 
titude of'many of the ioreignoi^s, especially the J.ew3- The greater 
the economic and .cultural handicap, seemingly, the greater the 
zeal. 

.,(f) Ope might elaborate indefmitcly, but this is' suffleient to 
indicate that n,careful study of,'tlie individual case is the next' 
step after the,.rougii grouping of,a mass intelligence test.. It. is 
much easier, and far more aatiafyihg, to deal in broad statistical 
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trends than it is to tease out the vexatious problems of individual 

causes in voriation.-But, the latter is the next logical step in 

testing. 

11. Errors in grading undoubtedly play a part in the rank- 
order differences between the Thorndike rating and the instructors 
rating. Impreasionistic methods of grading, marked bias in 
weighting certain qualities in work ond too few facts for estimate 
often cause the instructor's grade to be a long way from the 
absolute facts. 


CONCLUSIONS 

1. 'While there is a fairly high correlation between academic 
grades and the Thorndike tests, upon analysis the approximation 
is found to be too rough to permit exclusion, inclusion, or the 
assumption that the highest test group (above 96) is peculiarly 
superior. 

2. Nevertheless, the college entrance tests are not without 
merit, offering ns they do, an initial point for analysis and 
judicious prognosis, but unfortunately, not scientific prophecy. 
Such tests are undoubtedly superior to any impressionistic esti¬ 
mates of the Freshman. It becomes necessary, however, to fol¬ 
low up the test findings with a careful analysis of the qualitative 
character of the score; to supplement with a common-sense in¬ 
vestigation of the nature of the high school training noting how 
well it dovetails into the curriculum of the particular student in 
question. The home, language, zeal, outside employment, and so 
on must be weighed and evaluated. The tests form but a part of 
a complex differential diagnosis. All factors must be carefully 
aummated analogous to a court's getting a perspective on cir¬ 
cumstantial evidence. 

3. "Whether the student is surpassing or falling below the 
Thorndike 'rank-order, he is equally of interest. At present such 
cases demand an investigation to “show cause.” 

4. Not only is the Freshman up for critical study and evalua¬ 
tion but the test purporting to evaluate him is equally on trial to 
show it has value. 

6 . A combination of Part I, form 6, and Part III, form D would 
probably be as valuable as all four forms; thus enacting a saving 
of 60 per cent in giving, scoring, and purchase price of blanks. 
But it should be added that for purposes of analysis, much is to 
be gleaned by a study of the qualitative character of all four 
forms. 



ROOT 


6. The rank-order comparison between the Tl.orndike teats and 
the academic fradea should be continued throughoul the colleeo 
couise, At present any assumption as to the superior 
value of the mass intelligence teat over the Freahmaii's L., 
performance, is speculative and idle. 



the UNRELIABIIJTY of M- a. and I. Q. BASED 
ON GROUP TESTS OF GENERAL 
MENTAL ABILITY.’ 


By Authuh I. Gates 
T oachcra Cullugu, Columbia Biiivciflity 


The iiracUce oC cumimUiif; muiital ui^'ca and IntolIiRcncc 
Quotients from of t^roiip tc.Hts of ffcneral niontal ability lina 

been qiieationocl rc-cantly on llicorelical tfrouiuls,’ and various 
workei's arc* dlNoovci'inpr Uio unreliability of tlieae jjioa.suros by 
comparing tho rcsulLs obtained from different tests.'’ This paper 
presents data which show tlml nt lensl under certain conditions, 
quite ridicidoua IQ'h may be derived from certain group tests, 

Tlie following tests were given on successive days to the pupiia 
of Grades I to VIII inclusive of the Scarborougli Scliool: Dear¬ 
born, Examination I or II, Haggerty, Della 1 or II, Holleys Pic¬ 
ture Completion or Sentence Completion, Illinois (III to VlH 
only), Otts Primary or Advanced, Nutionnl Intelligence, Forms A 
and D, (III to VIII only) nnd Meyers Mental Measure. The 
Stanford-Binet was given during the year to Grades I to VI 
inclusive. 

The tGat.s wore given to groups of twenty or leas and particular 
attention was given to time, instructions, priJviaion with pencils, 
etc. The pnpil.s had leai'ncd to take tests earnestly and we are 
confident that the test conditions in general were more uniform 
and satisfactory than will be obtained in ordinary school practice. 
The results were scored by on expert. 

TJje menial nge e^i»v«]ents of tlw on the several tests 

were computed by use of the ago norm lablea occompanying each 
tost.* In most cases the line describing the median age score was 
extended to cover such of our scores as exceeded the highest age 
norm given. From these data, IQ's were computed. 

Table I, which gives the data in detail for Grade I, illustrates 
the trentmont of results, The horizontal lines give the facts for the 
several subjects; the vertical columns give the facta for the class. 
Columns 1 to 0 give the IQ's which are summarized at the foot in 

'TlilH Htndy Is ii uoiilrlhulion o£ llu* Uopui'hiiont of Ediieiitloiml llL'seareli, 
Sciirlioi'ouj'li Scliool, Henrbornu/'h, jNo>v YnrJi, 

-F. N. Frouiniin. Tho IntorprotnLlon nii«l ApplIcnLlon of tlu; Intolllgencc 
QuiiliuiU. Joiirniil Kilueottonul PHypliuloa 3 ’. Jnninirj', 11)21. L. JI, Tc'rmiiii. 
Moutiil (JrowLli iiiul ly. .Tournul liStUiviitiunul PKvoholopy. OutoUoi', 1021, 
fsiii'oioiiy i>i), 

4''i)r L'xjuniilc, J. b. Sh-nqulHt, Jnurnul of Kdiicjillonnl nPHoarfli, Dei'., 1021. 
the N. 1. T., 'JVrmiiiifl Vtillojo iiorniH, uubUHlii'd In Die .I<iuriiiil of 
/’(fucuffonnl XloHoareft, C'chninrj', 1021, were uhciI. 
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the form, (1) the highest IQ in the class (2) the lowest, (3) the 
mean and <4) the mean deviation from the mean. Column 7 gives 
the mean IQ for each subject; column 3 gives the mean deviation 
of the subject's various IQ’s from his mean and column 9 gives the 
spread i, e., the subject's highest IQ minus liia lowest IQ. These 
data are summarized at the foot of ench column, 

The facts of Table I may be considered with reference to certain 
important school problems. 

1. Is the class, on the whole, composed of bi-ight or average 
pupils? A very general answer — bright — may be given, but 
the degree of brightness varies widely according to different 
tests. The mean IQ's range from 109 (Dearborn Examination) to 
129 (Myers). According to the one the group should do slightly 
better than average work, according to the other, very much bet¬ 
ter. According to the one the average pupil could scarcely com¬ 
plete a college course, according to the other he could do so with 
ease, Assuming the average chronological age to be six years 
according to one test the mental age would be 0.6 years corre¬ 
sponding to first grade ability, but according to the other test the 
mental age would be 7.8 years corresponding to advanced Grade 
11 work. 

2. Are the pupils of uniform or diverse brightness ? The 
figures for the lowest IQ nre fairly uniform, ranging from 92 to 
99 but those for the highest are diverse, ranging from 121 to 165. 
The mean deviation of IQ's from the average are for the Dearborn 
6.0 and for the Myers 12,3, with figures for the other tests scat¬ 
tering between these extremes. Recommendations concerning sec¬ 
tioning for purposes of promotion would depend very greatly on 
what test is used. 

3. What is the IQ of a particular pupil? Pupil A is given 
IQ’s ranging from 104 to 166, that is, by one test he would he 
classified as "average” by another a "genius." Pupil A has 
various IQ's ranging from 104 to 144, Column 9 gives the differ¬ 
ence in. points of IQ between the highest and lowest. The largest 
difference is 61, the smallest 16, the mean 32. On the average a 
pupil ranges from "average” to "very superior” intelligence de¬ 
pending on the test. If we take as measures of variability the 
mean deviation from the average IQ instead of the whole range 
the figures given in column 9 are of course smaller the greatest 
being 17.0 the smallest 3,8, the mean 9.3, That is if the average 
IQ is 118 in the average ease half of the IQ's obtained from the 
several teats will fall between the limits 108,7 and 127.3. Further 
statistical treatnnent is unnecessary. It is obvious that the varia¬ 
bility of the IQ's obtained by several testa all given within a few 
days is so great as to make prediction concerning optimum rate 
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TABLE I 


SHOWING I .Q.'a Outained by Pupils op Grade I in Several Tests 



1 

2 

3 

4 

5 

6 

7 

8 

9 


'E 
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o 

i § 



0 

4J 

N ^ 

Wffl 

0 , 

.a 1 

PH 

hJ h 

OOi 

1 

q 

Wp 


c 

ii 

s, 

II 


A 

124. 

104 

136 

124 

126 

144 

120 

9.0 

40 

C 

120.6 

121 

144 

114 

125 

131 

126 

7.7 

30 

D 

114. 

107 

122 

134 

102 

122 

in 

9.2 

32 

E 

135. 

IIB 

138 

126 

108 

121 

124 

9.2 

30 

F 

no. 

117 

no 

111 

112 

129 

116 

5.3 

19 

G 

133. 

112 

132 

116 

112 

125 

122 

8.3 

21 

H 

92,5 

99 

119 

106 

120 

115 

109 

9.5 

28 

I 

104, 

107 

140 

116 

111 

135 

119 

12.5 

36 

J 

96, 

99 

117 

104 

107 

162 

113 

14.8 

56 

IC 

103, 

92 

98 

98 

107 

99 

100 

3.8 

16 

L 

120. 

116 

131 

127 

114 

13G 

124 

7.5 

22 

M 

108. 

108 

125 

100 

D9 

123 

111 

9.2 

26 

N 

no. 

111 

135 

118 

126 

lU 

119 

7.5 

25 

0 

104. 

109 

139 

117 

lOG 

1G5 

123 

17.0 

G1 

P 

121. 

116 

137 

98 

117.5 

117.5 

118 

7.7 

39' 

Highestl35. 

121 

144 

134 

125 

165 

126 

17.0 

61 

Lowest 

, 92.5 

92 

98 

98 

99 

99 

100 

3.8 

15 

Mean 

113, 

109 

129 

114 

113 

129 

118 

9,2 

32 

M. D. 

10.1 

G.O 

7.6 

8.9 

.6-8 

12.3 

5.4 

2.2 

9. 


SUMMAIIV 

OF HI 

JSULTS 

FOR GRADE 

II n=10. 


Higho'Stl41 

147 

148 

156 

160 

196 

160 

17.6 

76 

Lowust 

; 103 

97 

122 

108 

92 

106 

114 

\ 

6.3 

21 

Mean 

117 

116 

132 

135 

124 

136 

127 

10.0 

36 

M. D. 

7.4 

7,3 

6.9 

12,4 

12.0 

15,4 

7.6 

2.8 

10 
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of promotion, possibility of completing college, etc. quite out of 
the question. 


RESULTS FOB GRADE II 

The results for Grade II are aummarizcd in the lowc.st section of 
Table I. For this grade, the group testa, nil of them non-verbal, 
are the same ns those used in Grade I. 

The results are similar. The IQ*s yielded by the Myera test 
show an average deviation from the mean ■which is more than 
twice that given by the Otis. One individual receives an IQ on one 
test which is 76 points higher than that given by another test; the 
difference between an average intelligence and idiocy. The 
average range of IQ for an individual is 35 poiirts. 

RESULTS FOR GRADES III to VIII 

Table II gives summaries of the data for grades III to VIII. 
This Table shows the ridiculous results which teachers and other 
workers are likely to obtain from efforts to derive M. A.’a and 
IQ’s from group tests in these grades. For example, one fairly 
bright boy i-n Grade VII earns a mental age of 46 years on one 
test giving nn IQ of 408. If they should take the results of 
certain tests seriously there are many pupils who could think 
rather pitifully of Sir Francis Galton whose IQ is estimated by 
Terman to be only about 200. According to the Myers test the 
average IQ’s of our Grades VII and VIII ia 261.’ Picture the per¬ 
plexity of the teacher test enthusiast who finds that pupil K in 
Grade V earns an IQ of 99 on the National test and 306 on the 
Myers. Many others are nearly ns hafiling. 

The variability of scores obtained by a given individual be¬ 
comes greater as the grade becomes higher, ns may be seen in 
Table III which gives the range of IQ's and M. D.’s for the aver¬ 
age individual in. each grade. 

These facts should not be interpreted as a sweeping criticism 
of the usefulness and validity of group tests of general mental 
ability. What is urged is a restraint of certain inappropriate 
uses of these instruments. We should not, it is clear, compute 
M, A.'a and IQ's from raw scores, but these raw scores them¬ 
selves may be put to profitable use. It has been shown elsewhere that 
these group tests at least those very verbal in content give sub¬ 
stantial correlations v?ith achievement in school work." 

’Ky.i could not be compuled for Natloiinl nud Otis HCorCH for most of 
our Clrailc All uad Till uuplls Iw.cause they earned hcotuu eouslderably 
lilKlior tlmn tliusc rcpresentod by the Hiic when It hpcomod horlzoniiil, 

“A, 1. (latcu, CurrclatloBB of InlcUlgcnct^ tcala wHli ncJilevemuut In seliool 
EuibJcclH. Joiirriiil of Kducatlonnl I'sychology, Muvcii, Aiirll niul May, 1022. 
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TABLE II 


M. I). OF 1. Q,’S roil TII13 


SIIOWINO IIIGIIIIST, LOWEST, MEAN AND 

GllADE ACCORDING TO THE SEVERAL TESTS. IN LINES 
1 AND a, DIFFIOUENT INDIVIDUALS MAV HE 
IlEl'IlESENTEI) DY EACH FIGURE 


GllADE III 
2 3 4 6 


89 10 11 


15’ P 




O' 


n ^ ^ m> sl- S' 


■| B 

El 

•A 

OJ 

k 


Highest IQ . 133 127 133 13S 147 171 154 106 143 16.8 76 

LowesL IQ. 95 94 90 106 100 93 80 90 98 4.6 16 

Mean IQ.112 112 109 120 120 120 116 116 116 8.8 36 

M, D. from Mean 8,9 7.2 8.3 B,9 10.2 20.0 15.3 16.2 8.7 2.2 11 

GRADE IV 

Highest .140 133 142 399 16G 176 162 174 164 Gl.O 292 

Lowest . 99 100 104 93 113 104 100 104 113 6.0 15 

Mean .120 113 124 168 136 128 126 136 132 17,2 73 

M. D. 7,1 6.1 6.6 61.4 12.4 11.0 10.6 14.0 10.8 10,2 62 

GRADE V 

Highest .139 131 136 169 151 324 166 U7 164 56.4 266 

Lowest .100 100 98 116 113 81 109 112 110 6.1 28 

Mean .116 113 120 139 134 169 132 133 132 19.4 88 

M. D. 9.6 7.2 10.0 13.5 9.2 79 13.9 7.3 12,3,11.7 6D 

GRADE VI 

Highest .160 141 170 162 164 361 191 1&2 180 49,3 218 

Lowest . 83 88 80 92 95 70 • 92 97 90 4.8 14 

Mean . 120 115 123 121 130 179 130 126 132 19,3 82 

M. D.18.8 12.9 20.2 16.9 16,6 76.6-20.6 13.0 21.8 11.9 55 

GRADR VII 

Highest .Not * 183 * 166 408 181,147 210 79,0 261 

Lowest .,...Given 109 110 74 94 104 103 7.8 26 

Mean . 137 132 261 138 127 169 43.9 146 

M. D. 14.2 18,0 96.217.3 9.2 19.6 24.4 77 

GRADE VIII 

Highest .Nob 148 * 138 404 168 141 186 86,8 286 

Lowest . Given 105 91 88 86 96 172 5.8 20 

Mean . 124 116 261 124 111 147 46,9 167 

M.' D. 9.0 8.2 66.1 14.2 8.9 13.7 16,9 64 


*Scores for nearly all pupils above the equivalent of highest 
ages given. 
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TABLE HI 

Range of IQ in the Mean Devintion from 
Several Tests for the Mean IQ for the Aver- 
Average Individual age Individual 


Grade I . 32 0,2 

n . 35 10.0 

III . 3B 8.8 

IV . 73 17.2 

V . 88 10.4 

VI . 82 10.3 

VI . 146 43,9 

VIII . 157 46,9 


THE CAUSES OP THE UNRELIABILITY OF IQ’S BASED 
ON GROUP TESTS 


All effort has been made to ascertain the causes of tlie oxtreinc 
variations in IQ given to the same individual by different tests 
although we probably have been unable lo discover tliem all or to 
evaluate accurately those that seem likely. 

First, the distribution of native mental ability in the groups 
upon which the tests were standardized has probably been un¬ 
equal. That this is often the case was clearly illuslvated in con¬ 
structing norms for the National Intelligence tests.’ Such dif¬ 
ferences are not necessarily eliminated by mere acciinuilation of 
vast numbers of measures; a foot that is now quite generally 
recognized. It is probably an important source of inequality of 
the test norms. 

Secondly, the character of school training, especially in read¬ 
ing, \vriting and arithmetic, affects the resulta considerably. For 
example, if certain grades were backward in arithmetic in com¬ 
parison with pupils upon whom norms were established, they 
would obtain lower IQ's in those tests which contained relatively 
large amounts oi arithmetical functions other things being equal. 

Again results will differ depending on the relative amounts of 
non-verbal material which the particular tests contain. Two in¬ 
vestigations have shown that in Grades HI to VIII the corx'ela- 
tlons between verbal and non-verbal teats are low; sometimes 
negative in grade groups.® In our results the association between 


’See L. BI. Tcrinuii nntl 13. D. Whitmire. Agp. nud Grade norma Jor Lliu 
Nnllonnl Intclllyeiice Tesla. Journal ol ISOucatloiial lloaourcli. Feljriiai'j’. 
1021|' and G, >1. Whipple, 'Jlie national Intelligence TcBts. Journal oC 
Educntlonnl HcBcarcli, June, 1U21. 

*J. P. Herring. ‘Verbal nnil nbatrnct elcmentfl In InLclllgcncc cxiimlim- 
tlouH, Journal Ednentlonal Psychology. December, 1021, and A I, Gatea, 
same lournal, Marcli, April and Stay, 1022. 
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verbal and non-vertal testa becomes lesa close aa the aubjccta 
become older, This fact is a partial explanation of the fact that 
the disagreement between IQ's is greater in the upper grades. 

The factor of grcfitc-st importance in our results is practice in 
group tests. Table II shows that Scarborough pupils earned IQ'a 
that are obviously too high. On the whole, the more practice 
preceding a particular test, the higher the IQ's obtained. There 
js.no doubt that practice results in very rapid improvement in 
such tests.® There are three ways in which practice will cause 
variations in IQ from test to lest: First, scores will advance con¬ 
siderably by virtue of general adaptation to test conditions; 
secondly, the gain will be relatively great in the particular tests 
which contain large amounts of identical or equivalent exercises; 
thirdly, the norms for the tests will be high or low, depending on 
previous practice in intelligence tests as well as on general mental 
abilities of the subjects on whom the norms were based. Do 
those who construct norms for their tests actually ascertain the 
amount, if any, of previous experience in tests their subjects have 
had? Without a doubt norms established on uninitiated pupils 
will differ considerably, native ability being equal, from those 
secured from pupils who have been tested extensively. 

Again, the cumulative procedure of. establishing norma prob¬ 
ably tends in the long ruu to produce norms that are too low. 
Testers probably succeed in controlling the time better than other 
conditions. In the long run numbers of students fail entirely to 
understand methods of procedure, skip pages, lose time through 
distraction, broken pencils, etc., etc., whereas the factors conspir¬ 
ing for higher scores arc fewer. Scarborough pupils were 
handled in small groups. They were provided with several 
pencils. They had learned to do their best in all "tests." Dia- 
'turbances and misunderstandings very seldom occured. These 
factors would tend to produce differential success depending on 
whether a particular test contained more numerous speed or power 
exercises. Well practiced pupils would probably have a con¬ 
siderable advantage over the inexperienced particularly in the 
former, because they make a quicker start and maintain a steadier 
performance. 

Finally, most of the Scarborough pupils are of superior in¬ 
telligence as evidenced by the Stanford-Binet IQ's (which aver¬ 
age about 117'“), by achievement in school subjects and by informa- 

“For oxnmpio, sue Kulglit Dunlni) nnil Afrnca Syndcr. Prnctlce KftectH In 
IntelllgoiiCG 'i’oslH. .foiii'nnl Ifixporiiiicntol Paycliology, 1020, p. 1157-377. 

"’TIilB Htatomont Is snailc bccnuHC most ot tlic Stunfurd tasCs were given 
before the oxperleiiee In group tests and hecuuse, on retesting tlillj year, It 
1 b found tlint pruetlcc In groui) and other tcets lino not caused iiny marked 
IncreiiBU In IQ. 
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tion concerning the social status of parents. It is possible tbal 
very bright children ■with a little practice may exceed average 
children in these testa by a larger amount than the IQ ratios 
would suggest. In support of thia view we find that some of the 
very bright pupils very greatly exceed tho norms for the grades 
bo whicli their mental ages corveapond in speed of rending. In 
depth or power of compreliension (Tliorndihc-McColl) liowever, 
their excess over the average, while marked, is not nearly so 
great, This would make for dilTerential success depending on the 
relative amount to which achievement in each of the several tests 
depends upon these abilities. 

It will not be profitable to speculate further; whut wc need is 
jxperimentfttion. These experiences have been sulRcient to make 
one very cautious in the interpretation of group test scores and 
particularly cautious in the use of the M. A, or I. Q. 

The group tests are chiefly useful for purposes of rough 
classification and for very rough prediction but either should be 
undertoken only after inquiry into several factors, First, has this 
pupil ever taken such tests before^ If so, which, when, and how 
many? We need data badly to enable us to make a rough correc¬ 
tion in such circumstances, Secondly, what has been the subject's 
training in school subjects? It was found, for example, that some 
of our Grade III pupils made enormous improvement in most 
verbal group teats as the result of having improved in rending 
during the interval between two testa. We need information con¬ 
cerning the transfer of improvement in all school subjects to 
achievement in group tests. Finally did the subject lose any time 
for any reason during the test? This matter assumes great im¬ 
portance in some of the group tests. If all of the pupiLs have had 
no (or the same amount of) previous practice in group intelli¬ 
gence tests if their school training has been the same and if no 
accidents occur the results, at least those of verbal tests, are 
very useful but coarse instruments for classification. 

Perhaps a change from the term “intelligence tests" to some 
such term as “classification tests" would have a favorable effect 
in reducing misunderstanding by teachers and laymen and in 
curbing misuse by over-zealous testers: It has been well said 
that the work of measurement "may soon need protection from 
over-extravagant hopes more than from hostile criticism.""' 

*‘i3, L. Tliorudlko. Moiifluromenfc In Bdueatlon. The Twonty-llrHt; Yoiir- 
booX of the Nntlonnl Society Stqdy o£ Eclnetilloii, I’lirt I, li, S. 1U2:J. 



NEWS AND COMMENT 


The Bureiiu of Vocational Guidance of Havvai'd University has 
taken over the publication of the National Vocational Guidance 
Association Bulletin. It is thoii’ purpose to enlarge and improve 
this Bulletin as support becomes assured for it. 

The Journal extends a cordial welcome to this new magazine in 
the field of vocational guidance. Professor Frederick J. Allon 
will serve as Editor. 


A NOTE ON POPULAR PSEUDO-PSYCHOLOGICAL 
BELIEFS 

ICornhauser and Jaclc.^on present data in a recent issue of this 
journal’ showing that actual business men do not use quack systems 
of judging character in their employment work. The vesiilts ob¬ 
tained by the use of thoir questionnaire are rather surprising in 
view of tile apparently succc.ssful exploitation of "applied psy¬ 
chology” by various charlatans who invade our larger cities, ad¬ 
vertise extensively in the newspapers and on the bill boards, give 
free lectures in the best hotels or theatres and then conduct large 
classes for four or six weeks at so much per head. Dr. Joseph 
Jastrow at Wisconsin has made a special study of these quacks 
and the writer believes as the result of conversations with Dr. 
Jastrow plus hi.s own observations in the quack-infected North¬ 
west that the merits of psychological re.search and applications 
are imperiled by this wide spread exploitation of pseudo¬ 
psychology. 

Pseudo-phycholog'ical beliefs amounting in some cases to super¬ 
stitions seem to be more common than most ef us realize. The 
writer in conducting a summer school course in Applied Psy¬ 
chology was amazed to discover the range of interests expressed 
by these adult summer school students, but even more so, by the 
beliefs shown in answer to a questionnaire. Tlie range of inter¬ 
ests included a desire to study the problem of learning, memory, 
how to study, business psychology, salesmanship, influencing 
people, personnel work, personality, vocational guidance, ab¬ 
normal psychology, psycho-analysis, spiritualism and character 
analysis. Below is given a summary of the beliefs expressed by 
these students at the beginning of the course in answer to a 
questionnaire. 

The above table speaks for itself. If mature summer school 
students exhibit such a variety of beliefs what must the average 
business man believe? It goes without saying that such a course 


'"A note for the extent to which Hyatcma of character nnnlysls arc used 
the Duslneaa World." Jour. Applied Psy., Yol. VI, No. a, Sept,, 1022, p, 3fl2, 
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gUMMARY or DBLiBrS 


EXPIIESSUD JlY API'LIJflD PSYCHOLOGY 
STUDICNTS 


Positive Positive Unknown or 


Do you believe in; Belief Disbelief Uncertain 


1 . AstroloBy . 2 

2. Chiropractic. 10 

3. Fortune Telling . 2 

4. Graphology... 5 

B. Hypnotism .. 12 

6. Memory Systems .. 12 

7. Mental Telepathy. 12 

8. Spiritualism... 6 

fl. Palmistry . 1 

10. Phrenology ................................... 6 

11. Physiognomy. 11 

12. PsychO’therapy. 9 

13. Absent Treatment. I 

14. Gifted Children are '‘Peculiav" 12 

15. Psychology Can Determine 

What Specific Job a Man Is 
Best Pitted foT...,,. 16 


11 

0 

18 

fi 

0 

7 

8 

16 

18 

14 

3 

1 

12 

8 


4 


7 

1 

0 

10 

0 

1 

0 

0 

1 

1 

6 

10 

7 

0 


0 


needs devote some time and attention to cvalunting the evidenee 
for and against a large number of pseudo-psychological systems 
following this up with a presentation of what applied psychology 
can do and can not do. Thug it turns out that phychological in¬ 
struction must serve as a sobering survey of the limitations of 
psychological applications. It may be that business men are free 
•from such false beliefs yet the undersigned classifieg himself as a 
"doubting Thomas." 

University of Minnesota Donald G, Patterson. 
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Clapahede, Edouard. Genevn, Switzerland, Problems and 
MelhodB of Vocational Guidance. International Labor Office, 1922. 
Price, 40 cents. 

Interest in vocational ^ guidance has been growing so rapidly 
that the International Labor Oilice has taken cog-nizance of it as 
a subject of international importance. About two years ago the 
Office appointed the University of Qenevn ag its agent to collect 
information regarding the progress of the movement throughout 
the world, and to prepare news items for regular publication in the 
International Labor Review. This work has been carried on in 
increasing volume and with widening usefulness. In the meantime 
Professor Claparede has been conceiving and directing investiga¬ 
tions fundamental to vocational guidance from his laboratory and 
from the Institute J. J. Rousseau, and he has brought out this 
brochure as a precipitation of the results of his study. 

It is not a book. It is rather a survey that just escapes the 
severities of outline presentation. Furthermore it does not treat 
all phases of vocfitionnl guidance. Though it recognizes the im¬ 
portance of the social, economic, physiological and educational 
aspect it treats specifically only the psychological, This it en¬ 
visages with great clearness. Particularly sane and proportion¬ 
ate is the critical discussion of the difficulties involved in the 
application of tests in practical vocational situations. In his 
summarized conclusions Professor Claparede gives what miglit 
be regarded as an international message: 

"In conclusion it may be well to summarize very briefly the 
steps which should be taken to place vocational guidance on a 
firm foundation. 

1. Psychological analysis of occupations and their classification 
according to the abilities required. 

2. Determination of corresponding abilities in individuals and, 
as a preliminary, the testing of tests to determine their diag¬ 
nostic, and even more their prognostic, value. 

3. Investigation of the .process of training and educability. 

4. Determination of the importance of general intelligence in 
the various occupations. 

G. It should never be forgotten that a forecast of ability will 
never be a certainty, but only a probability. Statistics should be 
prepared to determine ‘this probability. 

6. Efforts should be made to arrive at a uniform system of 
measurement so that psyohographs or psychological diagrams 
may be comparable between diffepent’countries and between dif- 
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ferent vocational guidance offices. Grading by percentiles apponra 
to be the most rational and least ambiguous mcLhod. 

It is in the social interests of the community that every man 
should be in the position for which he is best fitted. IL ia also 
desirable and increasingly in accordance.with the spirit of modern 
democracy that the various social functions should he allotted ac¬ 
cording to merit and not in virtue of any privilege. The only 
means of attaining this ideal is by a sound system of vccntionul 
guidance, All those who have at heart the hnrmonious orgunizn- 
tion of society, both employers' and worlcers' orgfiiiization.s, should 
therefore facilitate by all means in their power any investigation 
having for its object the establishment of industrial p.sychology 
upon a firmer foundation." 

Every* American phychologist who ia touching ever bo lightly, 
either in his teaching or in his investigation, upon vocational prob¬ 
lems, should ponder on this brochure. Ho will find po.sccl for him 
numerous problems for the experimental investigations so sorely 
needed, and he will find references to'works of European investi¬ 
gators that are too little known in America. 

Indiana University H. D. ICiTSON. 

PnEScOTT, P. C, The Poetie Mind. New York: The Macmillan 
Company, 1922, Pp, 308, $2.00- 

There are two classes of people lo whom this book should be of 
special interest. The first are the paychologisls. Professor Pres¬ 
cott has for the object of his study the working of the poet's mind. 
His evidence is from the most reliable source—namely, from the 
poets themselves. An English professor, he has cQUecled from far 
and wide slatoments of the poets and other creative artists con¬ 
cerning the source and .manner of their inspiration; and with a 
surprising unanimity of opinion he has found that they testify to 
a power within from which their creative works emanate and over 
which they have no voluntai‘y control. This mysterious source of 
power Professor Prescott attempts to identify with the subcon¬ 
scious mind, He seeks to show further, always depending for his 
chief evidence on the poets themselves, that the same principles 
which apply to dreams according to Freud apply also to poems, 
which are emanations of the Bubconscious mind just as much as 
are nocturnal dreams. Poems, like dreams, have their origin in 
thwarted desires. Step by step Professor Prescott parallels the 
two kinds of dreams, showing that the impulse, the censorship, 
displacements, condensations, fusions, and fictional gratification 
are common to both and have the same explanations. Whatever 
be the merits of his findings, he has decidedly done the psycholog¬ 
ists a service by bringing them into contact with ii field of investi- 



BOOK Reviews 


105 


gation which few of them are likely to be so well qualifled as he 
to explore—the mental operations during poetic inspiration as 
explained by the poets themselves. 

The book, however, should perhaps have even a greater appeal 
to the critic and the student of literature. In the first place, even 
if there is not a particle of truth in his thesis, it is a fascinating 
romance of the subterranean caverns of the human mind, In the 
second place, if his thesis is partly true, liia woi’k becennes valua¬ 
ble and suggestive. It sheds new light on such ancient themes 
as the relation of beauty to truth, the catharsis of tragedy, the 
universality of the greatest poetry, symbols and figures, and even 
puns. In the third place, it is very possible that his thesis is true. 
Once grant the existence of a subconscious mind of the kind ac¬ 
cepted by many modern phychologists and the rest easily follows. 
The subconscious mind is old and wise, but not accessible to the 
average individual. The poet is one who for comparatively short 
intervals does have access to it, though through no volition of his 
own. What have been regarded as his vague and misty dreams 
are in reality flashes of ti'uth from a deeper mind, which is racial, 
universal, unliampeved by the limitations of time and apace and 
immediatQ needs. Poetry, therefore, represents the highest wis¬ 
dom of the race. Scientists plod along, and by the aid of the 
conscious mind finally confirm what the poet saw in his vision, 
Shelley, without the aid of modern psychology, states the idea ex¬ 
actly in his Defense of Poetryi "In the infancy of the world, 
neither poets themselves nor their auditors nre fully aware, of the 
excellency of poetry! for it acts in a divine and unapprehended 
manner, beyond and above consciousness, and it is reserved for 
future generations to contemplate and measure the mighty cause 
and effect in all the slrength and splendour of their union.” 

It seems to me, however, that there is at least one rather serious 
inconsistency in the book. In Chaper VIII Professor Prescott is 
inclined to accept the conclusion of Wordsworth that emotions recol¬ 
lected in tranquility are "generally" the som'ce of poetry. In 
Chapter XV he attempts to -show that poetry is the result of 
thwarted desires: that, as the poet may not have the object of his 
desire, he seeks relief, even though it be a veiled relief, in a fic¬ 
tional gratification, as Keats, let us say, in The Eve of Saint Agnes. 
Such a relief is obviously needed and obviously would come when 
the emotion is powerful and not when it is recollected in tranT 
quility. Likewise in the last chapter Professor Prescott has no 
basis for even suggesting the possibility of poets for seeing spe¬ 
cific events in a literal sense, as Shelley foresaw his own death 
by drowning at sen. 

Ohio University. B. L. Jefferson, 
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TEt^RY, Paul WasiIington. Hoio Uwmerah /Ire Read. Chicago, 
The University of Chicago, Supplementary Educational Mono- 
erapha, No. 18, 1922. Pp. XIV+109. Price, $1.00, 

Part I of Doctor Terry's excellent tnonogrnph deals with studies 
of the reading of numerals by introspective methods. Part II 
contains an account of the use of photographic apparatus in deal¬ 
ing with this problem. 

It is the opinion of the reviewer that the chief value of the mono¬ 
graph lies in the suggested method of studying tho problem 
rather than in the results of the experijnenta, since a very limited 
number of subjects participated. Part II, involving the use of 
photographic apparatus, contains the records of six subjects; in 
Part I, the number of subjects Tanges in the various experiments 
from four to ten. 

In the first experiment, seven arithmetic problems wel-e solved 
by ten graduate students who kept notes on their experiences while 
reading the problems “with special reference to numerals.” These 
observations were organized and recorded in a' series of tables. 
The data made it possible to distinguish between a first reading 
and o re-reading in many instances as well as a partial and a 
whole first reading. 

Other experiments in which the method of introspective analysis 
was employed investigated the range of correct recall of numerals 
after the first rending, undertook an analysis of the rc-reading of 
numerals in arithmetical problems and studied the successes of 
louT subjects in reading numerals in columns. 

Important outcomes of the use of photographic apparatus are: 
*‘(a^ The average number of digits included by n pause on nu¬ 
merals is decidedly smaller than the average number of letters 
included by a pause on words, (b) The average duration of 
pauses on numerals is greater than the average duration of pauses 
on words in the cases of all subjects, (c) The percentage of re¬ 
gressive pauses on numerals is greater than the percentage of such 
pauses on worda." 

The final chapter of the monograph contains very pertinent sug¬ 
gestions for teaching children to read arithmetic problems, Inas¬ 
much as the rending of numerals requires closer attention on the 
part of the reader than does the reading of words, it is suggested 
that during the first reading pupils be taught to devote their 
entire attention to the condiUokis of ^e problem, developing, at 
the same time, skill in the partial reading of the numerals. Those 
conclusions are supported by the findings of .Gray and Freeman 
in thft field of reading. 

Ohio University. r. l, Morton. 
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Knight, Predbrick B. Qualitiea Related to Success in Teachinff. 
Teachers College, Columbia University Contributions to Educa¬ 
tion, No. 120, New York City. Pp. x+67. 

When and why Is n teacher a successful teacher? Many at¬ 
tempts have been made to answer this question in terms of such 
general categories as personality, poise, physical qualities, mental 
qualities, moral qualities, disciplinary sltill, instructional skill, etc. 
The list can be extended and subdivided almost indefinitely from 
one of the several score cards for teachers now on the market. 
The objection that can be made to the above descriptive terms is 
their generality. Although they are more useful than a “general 
impression" as a guide to getting a useable criterion of teacher 
success, more exact and less subjective measures would be wel¬ 
comed by the school administrator. The study here under discus¬ 
sion represents a contribution to scientific education in that it gives 
results and particularly an improved method of attack on this 
problem. 

The first chapter summarizes the studies of Meviam, Elliott, 
and Boyce in tliis field. Chapters II, III, and IV are concerned 
with the data of the author's investigation and the relative 
significance of the various traits and qualities studied. The last 
chapter gives a trenchant criticism of Boyce’s study. 

The general procedure of the first part of the investigation 
wag as follows. Ratings ns to the relative teaching ability of 1B6 
grade and high school teachei's in three different school systems 
were obtained. That is to say, the beat teacher was ranked first, 
the next beat second, etc., when compared with all the other 
teachers of a given system. Three such I’ankings on the general 
ability to teach were secured from the supervisors, the teachers 
themselves, and a selected group of pupils respectively. By the 
method of correlation the validity of these rankings, and their 
relation to age, amount of expei'ience, quality of handwriting, 
intelligence ns measured by test, major academic interests, normal 
school scholarship, amount of professional study during active 
service, and ability to pass a professional test (“A Trade Test 
for Elementary School Teachers" by Knight and Franzen) was 
established. 

A few of the more significant conclusions may be given. 

"By using the coefficient of partial correlation we find, in the 
case of elementary school teachers, that, the factors of intelli¬ 
gence and normal school scholarship being constant, there is a 
mutual relationship of +.67 between ability to teach and ability 
to pass a professional test.... The amount of professional study 
accomplished during active service is also indicative of success in 
teaching. 
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"In the case of high school teachers, intollcctmil tlilTGronces, os 
maasvu'ctl by mental testa, appear to be significant. For the 
selection of high school teachers the use of mental tests would be 
of value. 

"These data, as a whole, may bo intorpi;etcd to mean that the 
general factor of interest in one's work becomes the dominant 
factor in determining oua’.s aucces.s in teaching....other mensur¬ 
able traits, either alone ov in combinations, are not adequate ex¬ 
planations of teaching success, 

"This study indicates tlinb age, oxperieiico, quality of handwrit¬ 
ing, intelligence as measured by tests, normal school standing, or 
the expressed interests of teachers are not clo.sely reluLecl to suc¬ 
cess in teaching.” 

In the Second part of the study intereovrelnticyns were found 
among the traits teaching ability, ability to understand and man¬ 
age people, intellectunl ability, ability to manage things and 
mechanisms, general scholarship, skill in government or discipline, 
instvuctionat skill, initiative, nervous and physical strength, 
ability to command the respect of pupils and general ability to 
get results, the teachers rating each other on these qualities 
after the connotations of these terms had been explained to ilicm. 
Concerning these data the author concludes that the factor of gen¬ 
eral spread of estimate operates to invalidate sucli ratings. That 
is, "when a judge attempts to rate a teacher in some particular 
trait, his rating is a defense of his general estimate of that 
teacher, as well as a rating of the trqit under consideration.” 

Doubtless the future will see a scientifically accurate and serv¬ 
iceable measure of teaching ability. The results and methods of 
such studies aa this point the way to the solution of the problem. 

Colorado College Hermann Bemmers. 

Wallin, J. E, W,, The Achievement of Subnormal Children i/i 
Standardized Educational Testis. Miami University Bulletin, 
Series XX, No. 7. $0.60. 

In this bulletin of ninety-seven pages, Dr. Wallin gives the 
results of some educational tests administered by special clas.s 
teachers to about 300 St. Louis subnormal children. The tests 
used were the Ayers spelling scale, lists A to F and I, L and 0, 
and lists I and II in Starch's Spelling scale, Gray's oval readiiig 
and the spiral arithmetic excersises adapted from the Courtis tests. 

Dr. Wallin states that this “study should have a two-fold sig¬ 
nificance for educators interested in the study and training of 
feeble-minded and backward children; first, it is the only survey 
thus far made by several standardized educational tests of pupils 
enrolled in special schools for mental defectives; second, most 
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of the pupils tested had been psychologically examined and dif¬ 
ferentially dingnoaed, so that it ia possible to analyze the results 
from the educational tests with reference to the children's in- 
teliigcnco age, to their diagnostic classification, such ns imbeciles, 
morons, borderline, bacliward, visual aphasia cases, etc,, and to 
the grade assigned them by the special class teachers." 

The results of the cducjiUonnl te.sts show that it is a waste of 
time and money to attempt academic instruction to low -grade 
children below four years mentality and that little rending can be 
accomplished by child under the mental age of .six years. On. 
the other hand the tests show that subnormal children who may 
develop to about the nine-year montnl level should be taken care 
of in the public schools and that although their training should 
a reasonable amount of time should be devoted to academic 
be along the lines of the monumental arts and proper social habits, 
branche.'s. Dr. Wallin is convinced that it is of extreme im¬ 
portance to taice every precaution in placing children in schools 
and institutions for the mentally defective and that their educa¬ 
tional attainment ability must be considered as well as a mental 
diagnosis made. 

Ohio University. M. La Vinia Warneo. 


High Schools attd Sex Education'. A manual of suggestions on 
education as related to sex, Edited by Benjamin C. Gruenberg, 
Ph. D. Prepared under the direction of the Surgeon General, 
U. S, Public Health Service, in co-operation with the U, S. 
Bureau of Education. Washington, D. C., Government Printing 
Office, 1922. Pp. 98. Price ({lO.SO. 

This is a very helpful and practical book for teachers of nil 
young people of secondary school age. It makes clear the need 
of better methods of training in matters of sex. In the very 
earliest pages it differentiates sex education from sex informa¬ 
tion—a point which the lay mind seems to have been slow in 
appreciating. Sex information without interpretation of its mean¬ 
ing to society and the individual and Avithout inspiration to use 
it for the uplift of the race falls far short of its proper place, in 
education. This little manual has been built up out of the accotn- 
ulated experience of thousands ol teachers who have attempted to 
handle the delicate subject of sex. It outlines the necessary prepa¬ 
ration of teachers of sex education, discusses the type of person¬ 
ality necessary to make such teaching valuable and presents prac¬ 
tical methods and devices by'which sex education may be accom¬ 
plished through the regular courses in biology, general science, 
physiology, physical education, home economics, and the social sci- 



BOOK REVIEWS 


UO 

encea. Numeroua references arc cited in order tiiat the reader may 
have an adequate background for more detailed reading. In the brief 
appendices at the end of the book are some very valuable sug¬ 
gestions on the use of special Iccturesi exhibits, courses of study 
for teachers, personal hygiene and physicol examinations. A very 
comprehensive bibliography of books dealing with sex and sex 
education ends the book. As r manual of what is being done and 
can be.done in sex education this book deserves n place in every 
teacher's library. 

Ohio University. G. H. Giiowdon. 

The World Book' Company, Yonkers, N. V., and 2123 Prairie 
Ave.p Chicago, ill., announces the following's 

1. Otis Self-AdminiBlering Teats of Mental Ability, a new 
series of tests for grades from four to twelve and for college 
•freshmen. The Higher Examination is for grades nine to twelve 
and college freshmen, the Intermediate for grades four to eight. 
Experimental try-outs have been given in preliminary editions. 
Results have given high coiTolations with tenchevs’ marks and 
estimates, Pour new advantages, it is argued, are to bo had in 
these tests they are largely self-administering, very easily and 
quickly scored, afford a flexible time limit, and n wider variety of 
test material. There are two forms, A and B, each of equal 
difReulty. The Directions and Key with each package of 2B, price 
$1.00 for Interinedinte, $1,10 for Higher Examination. 

2. Pintner-Cunningkaan pTimafp Menial Test'. This is a new 
, group test for the kindergarten, firal: ^nd second grades and the 

only one on the markat suitable for kindergarten pupils. It has 
been tried out in several previous -editions. The advantage of 
a test applies to the kindergarten and primary grades are that 
it enables the teacher to classify beginners (with no previous 
school record), and also to discover by eompaiMson of results, the 
degree of everlapping in mental ages. 

The examination consists entirely of pictures. No reading or 
writing is necessary on the part of the pupils. The administering 
is sufficiently simple to require no special training on the part of 
the teacher. 

The examination booklets ore sold in packages of twonty-flve 
at $1.45 net per package. The postpaid price of n Specimen Set 
is 20 cents. One Manual of Directions, one Class Record, one 
Report to Author and Percentile Graph arc included in each 
package. 

S. National Intelligence Teats, Supplement No. 2. The Com¬ 
mittee on National Intelligence Teats of the National Research 
Council has prepared Supplement No. 2 to the Manual of Direc- 
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tions foi‘ the tests. This supplement contains revised age norms, 
based upon the examination of 32,372 pupils in nineteen com¬ 
munities; composition of material for the age norms; data show¬ 
ing variability of the average mental ability of children from 
city to city; mental age equivalent of scores; revised grade norms, 
with tables showing composition of the -materials used, and a 
formula for finding IQ's and table for converting years and 
months into months. 
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Boohs nnd pamphlets for review should be sent to Jnmes P. 

Porter, Department of Psychology, Ohio University, Athens, Ohio. 

Bobbitt, Frankun. CuiTicnluni-flfafctnp in Lob Angelee. Sup¬ 
plementary Educational Monographs, No. 20, June, 192a. 
University of Chicago, Chicago, Ill. IOC pp. 

Bonner, H. R. Statistics of Teackei'a’ Colleges and Normal 
Schools.. 1919-1920. Department of the Interior, Bulletin No. 

8, 1922. Washington, D. C. 68 pp. 

Consolidation of Schools tn Maine aivd Con»ieciicitt. Department 
of the Interior, Rural School Leaflet No. 4, 1922. Washington, 
D, C, 12 pp. 

Cook, Katherine M. Supervision of Rural Schools. Department 
of the Interior, Bulletin No. 10, 1022. Washington, D, C. 
Ill pp. 

Grafts, Wilbur F. That Bon omd Girl of Yoitrs —Sociology jrom 
Vieiupomt of the Family. The Baker & Taylor Company, a54 
Fourth Avenue, New York. Price $1.76. 4.32 pp. 

Depfenbaugh, "W, S. Adniinistrattou of Schools iu the Smaiier 
Cities. Department of the Interior. Bulletin No. 2, 1922. 
76 pp. 

Delgado, Honohio P. El Dibujo dc los Psico 2 )atas. Casilla 1689, 
Lima, Peru. 26 pp. 

Epson, Newell W. Status of Sex Education in High Schools. 
Department of the Interior, Bulletin No, 14, 1922. Wash¬ 
ington, D. C. 12 pp. 

Pitt, A. B, The Htiman Instincts in Business. The Lothian 
Book Publishing Company Pty., Lid. The Rialto, 497 Collins 
St., Melbourne, Australia. 

POLMBR, Anth and GeRRITSZ, J, Tiidschrift Van Den Neder- 
latidschen IPerfciooafceids-raad,^ Bureau; Siugcl 630, Amster¬ 
dam. ' 

Gesbll, Arnold. Exceptional Children-and Picblia School Policy. 
Yale University Press, NewHaven, Conn. 6G pp. 

Givler, Robert Chenault. Peyehology—The Science of Human 
Behavior, Harper & Brothers, Publishers, New York. Price 
?3.00. 382 pp, 

Hebb, Bertha Y. Value of the School Census. Department of 
the Interior, City School Leaflet No 3. Washington, D. C. 

Hoke, Roy Edward. Ifnpi'ovement of Speed and Accuracy in 
Typewriting. Johns Hopkins University Studies in Educa¬ 
tion, No, 7. Johns Hopkins Press, Baltimore, Md. Price 76 
cents. 41 pp. 

Home Economics in RimAL SciiaoLS. Department of the Interior. 
Home Economics Circular No, 13, May, 1922. Washington, 
D. C. 16 pp. 

Hood, William R. Review of Educational Legislation and 
1920. Department of the Interioi*, Bulletin No. 13, 1922, 
Washington, D, C. 30 pp. 

John, Walton C. Siatist'ics of ApricuUurnl a7ul Mechanical 
Colleges for 1919 avd 1920. Department of the Interior, 
Bulletin No, 27, 1922. Washington, D. C. 29 pp. 

Junior High School Mathematics. Course of Stud;; and Syllabus. 
Cleveland Board of Education, Cleveland, Ohio. 46 pp- 
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INTRODUCTION 

The facial exiirossion portrayed in nn advertising cyt is fre¬ 
quently an important factor in the sale. Efforts to liortray ''satis¬ 
faction” are quite common, and it is to this feeling that the present 
study ia confined. 

Exjoerimcnts upon the effectiveness of various types of adver¬ 
tising appeals have shown that this effectiveness varies with 
dilTci’enb commodities. This suggests that a similar relation may 
hold in the case of facial expression and that perhaps a satisfied 
expression in a cut may have quite different value in advertising 
difl'erent varieties of goods. It would seem, a priori, that certain 
purchases arc serious and that pronounced satisfaction in the 
facial expresaion would be misplaced, while with other objects 
whose use normally provokes considerable satisfaction, such an 
expression would be desirable. It is .probable tbat the advertiser 
sometimes errs in the use of such facial expressions, One notes, 
for instance, cuts of a man laughirtg moderately at a game of 
solitaire or smoking a choice cigni- with marked solemnity. Per¬ 
haps this is correct or perhaps it is iiTelevaint but at least it sug¬ 
gests a problem. 

The following study is devoted mainly to the problem of whether 
the optimal degree of satisfaction portrayed in the facial expression 
of an advertisement varies with the commodity advertised. A sub¬ 
sidiary problem is whether the apparent satisfaction in the facial 
expression of a photograph con*esponds to the actual satisfaction 
felt by the subject who posed for it, i. e., whether the picture act¬ 
ually conveys the feelings intended. 

It is impossible to approach such problems by strictly objective 
methods. The only possibility is to obtain observers' judgments as 
to how they would react to certain piclurea with reference to the 
purchase of various commodities. Judgments of this sort are per¬ 
haps difficult and none too reliable but, with a sufficient number of 
observers and proper control of material and conditions, are un¬ 
doubtedly more valuable than a prioi-i generalixation, 
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MATEUIAI.. 

Two sets of inateri5\i were used in the expoviwent. The fnsl 
consisted of a series of bust photoKi’iipha n£ the anme male subject 
showing dilTercnt facial exprossifiiis, Considerable preliminary 
work was nccessiu-y in scenvinj; a subject who could pose properly, 
The set finally used consisted of six photOBfaphs that were taken 
in succession, with the subject in the same jmsilion. The lighting, 
exposure and other lechiucal aspects were enustunt. The subject 
posed in succession six increaKing doKreca of siitinfactiou sturting 
with slight uiid ending with rather extrejne, lie was conlidont of 
the climactic ed’cct and corroborated this by ranking the pictvwes 
subscc\uently. 

A set of these photographs was enlarged to 7x9 inches and each 
one mounted without margin under celluloid for dnylight display, 
Contact prints 4x5 inches were mounted individually on white 
cardboard of suitable size for projection in a BulopLicon. 

The other material consisted of Z’i cuts of men’s fuccs taken 
Irotu current advertisements and portraying various degrees of ap¬ 
parent satisfaction. It was thought beat to limit the faces to those 
of one sex thus avoiding an additional vardablc. The advertise¬ 
ments were trimmed so that none of the copy remained, nnd so that 
nothing in the cut suggested the kind of commodity advertised. It 
was impossible to control size but all the cuts were sufliciently large 
and sufficiently well printed to be seen without difficulty when pro¬ 
jected on the screen. Preliminary experiment.^ .served ns a basis 
for selecting this final set of cuts fi‘om a somewhat larger number. 
The cuts were centered on .white cardboard of suitable size for 
projection. 

For presenting the enlarged photographs a display board was 
used. This consisted merely of a medium gray cardboard about 
2x3 feet mounted on a light fi*amework with the longest dimension 
horizontal, There was a narrow gray rack at the bottom of the 
card and the top was tilted slightly away from the ob.server so that 
the photograph could rest against -the background. For the small 
photographs and the cuts a Balopticon was used to project them 
upon a screen, A metal plate actuated by a spring held the card 
on which the picture was mounted in position arid to change ma¬ 
terial it was necessary meraly to depress the plate and insert 
another card, 

METHOD. 

Series I employed the enlarged photographs nnd the display 
board. The experiments were made in daylight with one observer 
at a time and all the results recorded by the experimenter. This 
series comprised three parts, which were given in succession. 

In Series lA the photographs were presented one at a time in 
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I'andom ordur ((liffereiib for each subject) with the instructions,. 
"Describe -fully the feeJinffs which this picture suggests to you.” 
The complete introspection was recorded and subscciuently an¬ 
alyzed. 

In Series ID the obsorver was given the six photographs in a 
pile arj'anged in random order and was told; “These pictures were 
taken when the subject felt different degrees of satisfaction. Ar¬ 
range them in order with the one showing the most satisfaction on 
this .end and the one showing the least satisluction on this end.” 
The observer’s ranking was recorded in terms of the key letters on 
the backs of the photographs. 

In Series IC the photographs were again sliown singly in ran¬ 
dom order with the instructions: “Name five commodities for 
which you think this picture would be effective in an advertisement. 
For which of these live would it be most effective, next most effec¬ 
tive, etc.?” Tlie five commodities mentioned were recorded in order 
for each photograph. 

Scries 11 practically repeated series I using the group method 
of experiinciitatioii. The ti'calincnt of results was identical, The 
smaller photographs were projected on the screen. The room was, 
of course, daih but could bo illuminated sufficiently for writing by 
merely opening n door in the side of the Balopticon. The pictures 
were each given a key letter ami presented in the same order* in all 
three parts of the scries. This order began and ended with mod- 
rate degrees of satisfaclioii and no two adjacent degrees occurred 
in succession. 

In .Series IIA and Series IIC the instructions wore identical with 
those of lA and 1C. A picture was pre.sented and its code letter 
given ^verbally). After thirty seconds of darkness the room was 
illuminated for thirty seconds during which time the observers 
recorded their introspection on a blank; Another similar alterna¬ 
tion of darkness and illumination followed for the benefit of those 
who had not finished or who wished to note further aspects. A 
third alternation was given if requested by any observer. 

Series IIB involved ranking the photogi*aphs. Previous to the 
experiment the following six degrees of satisfaction had been 
written on the blackboard, but the observers’ attention not called 
to them until the proper time. 

1. Extremely satisfying. 

2. Very satisfying. 

3. Quite satisfying. 

4. Fairly satisfying. 

5. Slightly satisfying. 

6. Very slightly satisfying. 

The instructions were as follows: “These pictures were taken 



117 


BUUTT-CLMIK 


when the subject felt (li(Tercnt (logroes of siilisfacLioii. These de¬ 
grees arc as foUo^vs, (oxpcrinu'iiter points Ut llu! list on hoard), 
You are to write clown tlie six lettcsis iiiul tlio six niiinhera with 
the proper letter. I will show tlic picture.H in succesaion several 
times so that you can decide carefully.” The pliolograplia were 
then shown repeatedly in the siiinc order nrid the eodc letter stated 
for each as it was shown. Eacli prcseiilation w.as of fifloen sec¬ 
onds duration followed by a lew seconds illuniiiiiiLion. 

Sorlcit 111 employed the ,six small phologrnplus and the twenty- 
three cuts in a group oxporiineiiL In the discii-ssion nf results 
the former will be designated lllA anti the laller IIIH. They wore 
given, however, at one .sitting with the photograph.s in a random 
order followed by the cuts in n random order. These scries were 
concerned only with the in'oblem of cOTnmoditie.s and the jvulgmcnta 
were controlled rather than spontaneous. It hail been found that 
practically all the commodities mentioned spontaneously in so'ies 
1C and lie could be suinmarizcd under ten classes (cf. infra, table 
II). Accordingly, a mimeographed blank was provided with ruled 
columns headed with the names of these claascs. Successive rows 
were likewise ruled and numbered at the left from i to 29. The 
blanks were distributed and the following insti'iictioms given. 
"This is an experiment upon facial GXpre.ssion.s in rehitioii to ad¬ 
vertising. I am going to sliow you a series of pictures nnd in each 
case yon arc to judge for whnt classes of commoditic.s the picture 
would be elTective in an tulverti.somont. By effective is meant 
whether it would induce persons to buy the commodiLy in question. 
Confine yox\r answers to the classes listed on the blank. After the 
number of the picture put a 1 in the column to indicate the com- 
modity for which it would he moat effective and 2 in the column ta 
indicate second choice. You may mark other choices if you wish 
but always give at least two.” 

A picture was presented and its number given. After fifteen 
seconds the room was illuminated for fifteen seconds, (an assist¬ 
ant operating tlie wall switch) for the ohaevvers to record their 
judgments. Another alternation of picture and illumination fol¬ 
lowed, The experimenter then queried, ''All right?” and if tliere 
was no request for further repetition proceeded to the next pic¬ 
ture. There was no break between series IJIA and IIIB. 

The ranking of satisfaction portrayed in the photographs was 
obtained from the subject who posed. As this was impossible with 
the cuts, fifteen observers who did not participate in so'i'os ///, 
rniilced them. These observers were individually given the twenty- 
three card.s and told to arrange them with the one showing the 
most satisfaction on the top of the pile and the one showing the 
least on the bottom and the intervening ones in order. The pile 
was returned to the experimenter who recorded llic order. Then 
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the fifteen ranks given each picture were averaged. There was some 
disagreement among the judges in their I'nnkings of the various 
cuts. Tlio mean variation of the firteon ranlcs assigned to each 
picture was compvited. The smallest of these mean variations is 
l.G, the largest 0.7, and the average 4.2. If two pictures in this 
series Jiad each this mean variation of 4.2, the probable error of 
clifFevence would be 1.3. So it would scorn that a given picture was 
located at loEist within a few places of its correct po.sition. 

The subjects wore students—^mostly undergr-oduates—in p.sychol- 
ogy cla.s.^es at Ohio State University. Series I had 9 subjects, 
series II, 10, and series III, 67. The gi’oup expcrimeiiL.s were eon- 
ducted by tliG senior writer, (Burtt).' 

RESULTS. 

The minor problem above mentioned will be discussed first, viz., 
the correspondence of satisfaction actually felt with that apparent 
In the facial expression. Series fO and IW give the most direct 
answer to this problem- For convenience in subscciuent discussion 
tlie .six photographs ivlll be denoted by the letter.s U, V, W, X, Y, 
and Z, witli U the one in which the subject who posed felt the 
least satisfaction, V the next degree and so on up to Z the greatest 
satisfaction. The extent to which the observers’ rankings of tlie 
six photographs correspond to this order of ssilisfaction felt by the 
subject is sliown in Table I. 

TABLE I. 


AVMUAOM UA.NKS. 


Series 

U 

V 

W 

X 

Y 

Z 

IB 

5.8 

4.7 

4.4 

2.6 

2,2 

1,2 

IIB 

5,9 

4.9 

4.0 

2.4 

2.4 

1,3 

Both 

5.8 

4.8 

4.2 

2.6 

2,.3 

1.3 


The original ranlcs were tabluated with the six made by a given 
observer in a row. Then the columns were averaged to obtain the 
average rank assigned each photograph. These averages appear 
in table I, for series IB, IIB and both together. 

It is obvious tliafc tho observers judged rjuito accurately tlic 
satisfaction felt by the subject of the photographs.^ Considering 
the averages of both series the correlation is perfect. Moreover, 
the more detailed results show that nil but three of the twenty-five 
subjects ranked. U lowest and all but two ranked Z highest. The 
spontaneous descriptions of feelings suggested by the photographs 
indicate a rather climactic order from U to Z. 

Thi.s suggests LangfeldV finding,—covering a wide range of 
Jatiniiil of Aliiioriii. Paypli. 1018, 1.S, 1T>. 

emotions and attitudes but not the one specifically studied in the 
present case,—of “uniformly good and consistent" judgments of 
emotions from facial expression. 

'Tlu' wrlloi'i^ lire liulclnoU for sniiiu siiKt'i'SlIonH lUu'liiK I lie csirlli'i' sIhkus 
of l)jf‘ n-orli (i) ]3r, Hurry W. Crniio. 

^Langfelil, II. S.; Tho Judi/mciil of Ummions from ?''«< Inf ij'iii. 
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The mfiin problem of the cxpeviment wes the effectiveness of 
vai’ioua degrees of nppui’cnt satisfiiction for lulvcrtising various 
commodities. The results will be considered in terms of the 10 
classes of commodities under which practicnlly all tlio sporitancoug 
judgments fell. The results for scrica IC and IIC were combined, 
as both usutl spontaneous reports on the anmu six photographs, A 
preliminary tabulation ^vas made to show Uic number of times each 
commodity was mentioned iti connection wiUi each picture. Sopa- 
rate tables were made for first choicc.s, second clioiccs, etc,, and 
total choices. Series J/M which involved the same mntcrinl with 
controlled judgments was tabulated in the uamu w£\y. In aeries 
IIIB it did not seem worth while to evaluate each picture sepa¬ 
rately especially in view of the rather considemblG disagreement 
among the fifteen observers whose judgments provided the original 
ranlnngs for satisfaction. To facilitate comparison with the other 
series of six photographs the cuts were arbitrarily combined into 
six groups on the basis of the average satisfaction rankings. Each 
group coniprigcd 4 cuts with the exception of the lowest satisfaction 
group which comprised 3 cuts. The division was mnclc in this way 
to avoid drawing the Une between cuts with the sumo average 
rank. A preliminary tabulation was mode to .show the number of 
times each commodity was mentioned in connection with each of 
these six groups of cots. Separate tables were made for first 
choices, second choices and total choices, 

The results could now he consiidcred from two standpoints. On 
the oiiQ hand it wns possible to determine for uacli commodity what 
proportion of the mentions were accorded to micih picture or group 
of pictures, 1, e., what degree of satisfaction was most frequently 
selected as appropriate for a given commodity. On the other hand, 
it was possible to note for each picture or group of pictures what 
proportion of the mentions were accorded to each commodity, i. e., 
what commodities wcyd most frequently selected ns ones for which 
a given degree of satisfaction would be appropriate. 

Table II presents the results from the former of the above gUnd- 
points. 
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TABLE ir. 

I'I3IIC)JNTA(JK DI.STHJBUTHIJ? Oli" TOTAT^ CIH>ICJ3S FOIl ISAC'II 
COMMtJDITY. 


Commodity 

Series 

n 

U 

V 

W 

X 

Y 

Z 

Amusements—indoor 

ic-i-iic 

33 

3 

3 

12 

21 

27 

38 


III A 

87 

1 

25 

22 

23 

14 

IB 


III B 

287 

3 

12 

31 

16 

22 

17 


Av. 


2 

13 

22 

20 

21 

22 

Amusements—outdoor 

IC+IIC 

14 

0 

14 

7 

29 

21 

29 


III A 

98 

0 

13 

12 

32 

20 

17 


III B 

313 

1 

11 

19 

30 

27 

12 


Av. 


0 

13 

13 

30 

25 

19 

Automobiles 

ICH-IIC 

15 

20 

27 

20 

20 

7 

7 


in A 

55 

4 

13 

15 

20 

33 

16 


m B 

276 

a 

7 

29 

23 

7 

26 


Av. 


11 

16 

21 

21 

16 

16 

Clothing 

IG+IIC 

94 

24 

14 

18 

15 

18 

11 


III A 

106 

51 

18 

13 

4 

5 

9 


III B 

425 

32 

16 

Id 

21 

3 

10 


Av. 


36 

16 

16 

13 

9 

10 

Food 

IC+IIG 

37 

0 

0 

16 

27 

32 

24 


III A 

70 

0 

11 

21 

16 

26 

26 


III B 

253 

3 

23 

14 

12 

29 

18 


Av. 


1 

11 

17 

18 

29 

23 

Photographs 

IC+lIC 

18 

44 

11 

22 

22 

0 

0 


in A 

127 

51 

15 

9 

7 

9 

8 


III B 

205 

31 

22 

11 

11 

10 

14 


Av. 


42 

16 

14 

13 

6 

7 

Publications 

IC+IIG 

19 

21 

0 

5 

26 

11 

37 


III A 

33 

3 

9 

30 . 

.12 

12 

33 


III B 

254 

15 

28 

13 

6 

13 

25 


Av. 


13 

12 

16 

15 

12 

32 

Schools 

ic-hiic 

22 

55 

14 

18 

0 

9 

5 


III A 

23 

26 

4 

26 

4 

22 

17 


III B 

230 

13 

46 

7 

10 

13 

10 


Av. 


31 

21 

17 

5 

15 

11 

SmoUing supplies 

IC+IIC 

48 

4 

12 

17 

25 

19 

23 


III A 

84 

4 

30 

15 

21 

17 

13 


III B 

312 

6 

12 

9 

16 

16 

42 


Av. 


6 

18 

14 

21 

17 

26 

Toilet articles 

IC-hllC 

92 

4 

7 

11 

33 

20 

26 


III A 

67 

2 

13 

10 

25 

18 

31 


III B 

352 

15 

10 

23 

14 

29 

9 


Av. 


7 

10 

15 

24 

22 

22 



F'isrure i 
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The original figures were reduced to per cents to make the vari¬ 
ous series comparable. Only "total choices" are considered. First 
choices were tabulated separately but did not dilfor substantially 
from total choices and the latter were then selected because they 
involved a larger number of cases. The first column gives the 
classes of commodities, the second the series and the third the 
number of choices or mentions involved. The following six figures 
in a given row indicate the per cent of mentions for each of the 
six pictures or group of pictures. The headings U, V, W, etc., 
indicate increasing degrees of apparent satisfaction from U to Z; 
for series 1C, IIC and IJIA they denote the six photographs, and for 
IIIB they denote groups of four cuts except that U involves only 
three cuts. For example, of the thirty-three times indoor amuse¬ 
ments were mentionod in series IC and IIC, three per cent of these 
mentions were for photograph U, three per cent for V, twelve 
per cent for W, etc; while of the 287 mentions of indoor amuse¬ 
ments in series IIlB, three per cent were for U, twelve per cent for 
V, thirty-one per cent for W, etc. Moreoverj the average of the 
three series ns far as indoor amusements are concerned gives two 
per cent for U, thirteen per cent for V, etc. 

These same results are shown graphically in Figure 1. 

The ten sets of curves correspond to the ten blocks in Table II, 
In each set the different lines denote the three series and the aver¬ 
age of the three as aliown in the key. The abscissae of the curves 
denote from left to right the six classes U, V, W, X, Y, Z, while 
the ordinates represent per cents. The total of the ordinates of 
each curve is, of course, lOO per cent. It should be noted in the 
figure and the table that the value for U in series IIJB should be 
perhaps a trifle larger as it involves three pictures instead of four. 

The results arc considered from the other aforementioned stand¬ 
point in Table III. 
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TABLE HI. 

PBUCENTAGE DISTRIBUTION OF TOTAL CHOICES FOR EACH 

PICTURE. 


u 

h 

s 

u 

m 

JH 

u 

□ 

u 

a 

tl u 

5 ® 

a 

0. 

E J" 

ai C 
ai o 

P-d 

Eo 

e 

E 

_q 

A 

c 

■a 

o 

o 

1 U] 

1" 

M u 

’li 

A a 

P o 

u 
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o 

a 

%> 

Si 

o'! 

n 

4J 01 

fit; 


W 

<s 

o 

<!a 

O 

fe 

Ch U 

A’J 

w 

V) U 

Hn 

TJ 

IC+IIC 

2 

0 

5 

40 

0 

14 

7 

21 

4 

7 


III A 

1 

0 

1 

41 

0 

40 

1 

4 

2 

1 


III B 

2 

1 

6 

SB 

2 

17 

10 

a 

B 

14 


Av. 

2 

0 

4 

39 

1 

27 

6 

11 

4 

7 

V 

rc+iic 

3 

6 

11 

36 

0 

5 

0 

8 

16 

16 


III A 

17 

10 

6 

16 

G 

15 

2 

1 

20 

7 


III B 

7 

7 

4 

14 

11 

0 

14 

21 

7 

7 


Av. 

9 

7 

7 

21 

C 

10 

B 

10 

U 

10 

IV 

IC+IIC 

7 

2 

6 

29 

10 

7 

2 

7 

14 

17 


III A 

16 

10 

7 

12 

13 

10 

9 

5 

11 

6 


III B 

17 

11 

16 

16 

7 

4 

6 

3 

B 

16 


Av. 

13 

8 

9 

19 

10 

7 

6 

B 

10 

13 

X 

IC+IIC 

3 

B 

3 

16 

11 

B 

6 

0 

13 

34 


III A 

16 

25 

9 

3 

9 

7 

3 

1 

14 

13 


III B 

10 

19 

13 

18 

6 

5 

8 

B 

11 

10 


Av. 

11 

16 

8 

12 

g 

6 

4 

2 

13 

19 

Y 

IC+IIC 

12 

4 

1 

23 

16 

0 

3 

3 

12 

25 


III A 

10 

20 

14 

4 

14 

10 

3 

4 

11 

10 


III B 

13 

17 

4 

3 

15 

4 

7 

G 

10 

21 


Av. 

12 

14 

6 

10 

16 

6 

4 

4 

11 

19 

2 

ic+ric 

14 

6 

1 

13 

12 

0 

9 

1 

14 

31 


HI A 

10 

14 

7 

8 

IB 

8 

9 

3 

9 

17 


III B 

9 

7 

14 

8 

0 

B 

12 

4 

26 

6 


Av. 

11 

9 

7 

10 

12 

4 

10 

3 

16 

18 
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The first column gives the picture or group of pictures and the 
next the series. The following columns in any row indicate the 
per cent of mentions for each of the ten commodities. For in¬ 
stance, with picture U in series IC and IIC, 2 per cent of the 
observers selected indoor amusementa as a commodity for which 
U would be suitable, B per cent selected automobiles, 40 per cent 
clothing, etc. 

Series 1C and IIC involved about fifty total mentions, series 
IIIA about 130 and JIlTi about BOO, for each photograph or cut. 
Figure 1 and Table III ahow fairly consistent results with certain 
commodities but not with others. 

The curves for indoor amusements agree in starting low ond 
they approach each other closely again at X. In Table III this 
commodity is seldom mentioned for U but more frequently ther&> 
after. Apparently slight satisfaction is undesirable while it Is 
not clear whether moderate or greater degrees are most desirable, 

With outdoor amusements the case is clear. The curves show 
marked agreement with a luinimuin at U and a maximum at X. 
In the tabic for X, onLcloor amusements stand next to the highest 
in average mentions. Evidently a rather marked but not extreme 
degree of satisfaction is the most desirable. 

It is impossible to draw any conclusion regarding automobiles 
because there is little cigreenient among the curves and the average 
curve is nearly level. 

The curves for clothing all start high and descend first abruptly 
and then gradually, while in the table, picture U has a large pro¬ 
portion of mentions as suitable for clothing. Evidently, the slight¬ 
est degrees of satisfaction used in the experiment were the most 
suitable for this commodity. 

Food shows a fair agreement in the curves, with a gradual rise 
toward the higher degrees of satisfaction. This relation is not as 
clearly manifest in the tabic, but on the whole it seems that n 
fairly high degree of satisfaction should be effective in food adver¬ 
tisements. 

The curves for photographs are rather similar to those for 
clothing and the tabular results also arc similar. Apparently, the 
slight degrees of satisfaction should be most effective, 

The curves for publications are equivocal with a suggestion of 
a uniform rise at the end. This fact is not clearly borne out by 
the table. 

There is considerable discrepancy at the left in the curves for 
schools although the average trend is downward. The table is 
inconclusive. If there is any suggestion it is toward the effective¬ 
ness of the lesser degrees of satisfaction. 

Smoking supplies show a fairly consistent and gradual vise in 
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the curves, The table indicates frequent mention of this com¬ 
modity, for all the pictures except U. It would seem that any but 
the slight degrees of satisfaction would be desirable and perhaps- 
there would be a slight gain in effectiveness as the satisfaction, 
was increased. 

Toilet articles have a fairly conaiatent vise through the lessei- 
degrees of satisfaction with little average change there.'ifter. In 
the table toilet articles are frequently mentioned for nil pictures 
except the first. It seems that an average or greater degree of 
satisfaction should be effective in advertising such articles, 

The above results depend of course upon the judgments of an 
untrained, unselected group of students. They may have judged 
in some instances by factors other than the one studied. Recogni¬ 
tion of a picture, for instance, might sometimes affect the results, 
the conclusion that for clothing and photographs, advertisements 
showing rather slight amounts of satisfaction should be more effec¬ 
tive than those sho-^ving greater amounts, while for outdoor amuse¬ 
ments, food, smoking supplies and toilet articles the moderate or 
high degrees of satisfaction should prove more effective. In the 
case of outdoor amusements and food there is a further suggestion 
that the satisfaction, if carried to the extreme, may lose somewhat 
in effectiveness. 

A further interesting problem would be to determine whether 
current advertising seemed to follow the above principles oi* to 
run counter to any of them. This would necessitate the collection, 
of a large number of advertising cuts end their ranking by a 
group of observers. A little evidence -may be obtained by coi\sid- 
ering the twenty-three cuts used in the present experiment in the- 
light of the commodities they had been originally u-sed to advertise. 
Table IV shows how the commodities originally advertised by the 


TABLE IV. 
U V 


Indoor amusements 
Outdoor amusements 
Clothing' 

Food 

Smokers' supplies 
Toilet articles 


W X Y Z 
1 1 

1 1 

2 1 

2 13 12 

1 

12 2 


cuts used are distributed through the six degrees or groups of sat¬ 
isfaction. There wore, of course, too few cuts for a given com¬ 
modity to permit much generalization, but clothing, for instance, 
occurs only in classes U and V which was .shown above to be a 
desirable situation. Outdoor amusements avoid U and V as they 
ought to. Food, smoking supplies and toilet articles for the most 
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part occur in the higher degroes but have some instances in U and 
V which according to the above flndings is undcsirablG, Without 
more data on this point it would be rush to criticize advertising 
policies but the method just described if applied on n large scale 
would doubtless be illuminating. 

The result.s of the n»ain portion of the experiment are, of course, 
applicable only to the extent that the facial expression of a cut is 
a selling point in itself, i. e., the apparent satisfaction of the user 
is'supposed to be an Inducement to the reader to buy. There are 
many occasions when there is some other leading selling point and 
the facial expression is one designed to emphasize it. In such a 
case, the foregoing results would be irrelevant. At any rate it 
seems clear that the odvertiser should not always strive to portray 
a maximum satisfaction in facial expressions but that the optimal 
degree varies with different commodities. 

SUMMARY, 

The foregoing experiment employed photographs posed by a sub¬ 
ject feeling different degrees of satisfaction, and cuts from current 
advertisements portraying apparently various degrees of satisfac¬ 
tion, Individual and group methods were used. The observers 
stated the feelings suggested by the pictures, ranked them for ap¬ 
parent satisfaction and gave the commodities for which they 
thought each picture would be most effective in an advertisement. 
The results were tubulated to show the correspondence between 
actual .satisfaction felt by the subject posing for the photographs 
and apparent satisfaction judged by the observer. The correla¬ 
tion proved to be very high. 

The result.^ were also treated in various ways to determine the 
optimal degree of apparent satisfaction for tadvertising different 
commodities. As far as the results go, the lesser degrees of satis¬ 
faction appear more suitable for advertising clothing and photo¬ 
graphs, while the moderate or high degrees are better for amiiae- 
ments, food, smokers supplies and toilet articles. 

The results are, of course, irrelevant when the facial expression 
of satisfaction is not itself a selling point, but in casos where it is 
a selling point the concluaion may be drawn that it is undesirable 
to always strive for the utmost satisfaction but that the optimal 
amount depends on the kind of commodity advertised. 



COMPARATIVE SOCIAL TRAITS OF VARIOUS 
RACES, SECOND STUDY 

By C. B. Davenport and Laooa C. CnAYTon. 

In “School find Society" for October 22, 1921, one of U3 published 
n study of “Comparntivc Social Traits of Various Races.’’ This 
study was based on only 51 indivuluala and was confessedly frag¬ 
mentary. 16 was published in the hope that it Avould stimulate 
others to make similar studies. How far this hope h.us been real¬ 
ized we can not say, but at least the first paper doubtless made it 
easier to secure cooperation of other teachovs in collecting such 
data. The present study is due to the interest taken by Dr. R. S. 
Benedict of the Stuyvesant High School, who undertook to secure 
additional data from his pupils and to whom we are greatly in¬ 
debted. These have doubled our totals. Since the latter are exclu¬ 
sively for boys, while the earlier were exclusively for girls it has 
seemed useful to combine the two collections to get results that 
may be expected to hold for the population as a whole. A compari¬ 
son of the sexes is hardly possible with the small numbers available. 

As stated in the earlier paper the purpose of the stiply is to 
replace opinion us to race dilTerenees in social traits by qunntita- 
tivG estimates. 

The method is exactly the same in the two studic.s. The incle- 
pendent judgments of one to three teachers were obtained con- 
cerning ten traits of each pupil, using the graphic rating scale of 
the Scott Company, Phiiadelphia ("Sclioo! and Society” XIV, p. 
315), The data were tabulated and appraised as stated in the 
eai'lier paper. Probable errors have been calculated in order that 
the significance of the dilforcnces may be made cleurev.* The re¬ 
sults are tentative, It is hoped that this paper may stimulate to 
further studies of this subject. 

RESULTS. 

Altogether 188 sets of judgments were rciulered on 102 person.?, 
ns follows: 20 on 10 Germans; 15 on 9 Irish; 37 on 22 Italians; 
59 on 31 Austrians, and 67 on 30 Russians, also IIC on 61 Jews, 
being the sum of the Austrians and Russians, just listed. 

There were calculated for each of these nationalities the mean 
of the judgments for each trait and the probable error of, the 
mean. These means and probable errors are given in Table I. 
Thus under Germany, Leadership, we find the mean of the 20 
estimates made on 10 persons to be 59.7±3.0. This means that the 
position of students of German stock, in respect to leadership, was 
on the average slightly above mediocrity, or 60%. There is, how¬ 
ever, an even chance that the true value (theoretically based on an 
infinite number) is only equally apt to occur within the range 
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66,7—62,7 tis outside thnt rnne'c. It is usually held that diffev- 
cncGs between two means whicli nre greater than three times the 
squnve root of the sum of the probable orrors of tlie moans is cer¬ 
tainly a significant difference; that it depends not merely upon 
small numbers, l)ut upon ii real difference in tlie "set” of these 
numbers. For exiiinplo, while the mean of 20 ostimatos concern¬ 
ing leadership of .sUuleiiL.s from Germany is 60.7:±:3,0, that of 16 
estimates of students born in Ireland is 38,3±5,0. There is, thus, 
a (liderence of 2J.15 in the mean of the judgments for the two 
countries. The RCiimre root of the .sum of the squares of the prob¬ 
able error.s is 5.8. Tlirce Limes 6.8 is 17.4 which is less than the 
difference of tlie moan.'?; hence the diffei'cnce between the means ].<? 
probably n biologically significant one. Even with the probable 
errors the "conclusions" must be held to be merely tentative; for 
the "probable error" lias not Llio significance with small numbers, 
that it has with large numbers. 
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In Table I the jneans and probable errors arc given for five 
nationalities, namely, jjupils who came, or whose ancestors caane, 
from Germany, Ireland, Italy, Austria and Russia. The students 
of Austrian and Russian stock in this New York City school are 
almost exclusively Jcw.s. It seemed worth while to combine those 
from Austria and Rus-sisi under the hending of "Jews", and these 
results are given in column r>. Table 1 then should give us some 
sort of an ans\ver, Lljough imperfect, to the inquiry with which 
we started ns to the difTcvence in social Irnit.^ of persons of differ¬ 
ent nationalities. 

CONCLUSIONS. 

While numbers arc .skill iinsuflicicnt to form final conclusions, the 
results suggest the following tentative conclusions. 

In leadership the German children stand first ut BD.TitS.O points 
quite markedly above the other's. The dilFerence between this rnea 
and that of the Jews is less than three times the probable erroi 
Nevertheless the Jews may be considered as a race characterize 
by a modiuin Icadci'ship. On tlie other Iinnd, tlie Irish and Italian 
are characterized by a low standard in leadership, and the dif¬ 
ference between them and the middle gi’oup is, doubtless, signifi¬ 
cant. 

In perlbiacitp the Gormajus stand first. This group is probably 
higher in re.specL to pertinacity than the Jews. The Irish and 
Italians stand lowest in this respect. 

In humor, the German cliildrcii stand first {02) and the Irish 
stand second. However, the difference between these two nation¬ 
alities is not great and, indeed, not to bo diiferentiated from the 
Austrians and the Jews in general. Between this group and the 
Italians there is probably a real difference in respect to national 
humor. 

In/)'a7i/i:ne.is the German children again stand first (67) and the 
Jews, and especially the Austrians, arc a close second. The Irish 
and Italians fell into a slightly lower class. 

In siispicioitsiiess, Jews and Irish stand above the others. Prob¬ 
ably the Italians arc not significantly lower. The Germans, how¬ 
ever, ai’Q ijrobably least in this respect and certainly are quite 
distinct from the Jews. 

In spjnpnthp the German.s stand highest, the Jews and Italians 
may be included in the medium category. The Irish are least in 
this respect. 

In loyaliy, the Germans stand highest, but in the same category 
are also the Italians and Irish. The Jews occupy a lower position. 

In i/e^ierosifj/ the Germans, Italians, Irish and Jews stand at 
nearly the same level. 

In obtrusiueomas the 61 Jews stand at the top (62) and seem to 



131 


DAVENPORT-CRAYTOR 


foYTn a class distinct from the Germans, Irish iu\d Italians which 
form a middle or lower- group. 

In cooiiiess the Germans and Irish stnnd easily Hrst (80). In n 
significantly lower group stand Lhc Italians anti Jew.s. 

The 10 Germans stand at, or near the top in Leiitlershi]), Perti¬ 
nacity, Humor, Frankness, Sympathy, and liOynUy, more than half 
the traits, They occupy n relatively low position in Siisi)icioiiRnGs.s. 

The 9 Irish fall in the upper group in respect to Humor, Suapi- 
ciousnesa, Loyalty and Generosity, imd in the lowest group in re¬ 
spect to Leadership, Pertinacity, Frankness and »Syinpathy, 

The 22 Italians stand in the upper group in regard to Loyalty 
and Generosity and lowest in regard to Leadership and Humor. 

The 61 Jewish children stand in the first group in Humor, Suspi¬ 
ciousness, Generosity, and Obtvusivencss and in the medium group 
for the other traits, 

In addition to the meaji values of the social traits for tlie differ¬ 
ent nationalities, there is a dilFerence in the variability of judg¬ 
ments of persons from different countries, and it has seemed worth 
while to consider this variation. Accordingly, the standard devia¬ 
tions of the judgments for each nationality and trait are given in 
Table III. The prohuble errors have also been calculated as a 
means of judgment of significance, or rnthor, lack of significance 
of the diiTerenco of these indices of variability. Thus, from Table 
III, it appear.s that the variability in the judgments on Leadership 
is greatest for the Jews the standard deviation being 28.1 ±1.3. It 
is least for the Germans, 20.0±2.1. Although the difference may 
not be a significant one, there is a suggestion that the Jew.s (as 
represented in our statistics) include strains that vary more from 
each other in Leadership than in the ease of the Germans. 

On the other hand in Pertinacity, the Italians showed ilieraselvcs 
the most variable and the Irish the least, although the difference, 
even in this ease, is less than three times the probable error. 
Again in Humor the variability in judgments rendered on Italians, 
Jews and Irish are high, and for Germans somewhat lower. One 
of the striking differences in Table III is live slight variability of 
the Germans in regard to Coolness (15,2), a trait in which they 
stand at the top, and the variability of the Jews in this trait 

(22.8) , a trait in which they stand at the bottom. Taking the 
average of the standard deviations of the ten ti’ait.'s for each of 
the nationalities, we find that the variation is greatest in the Jews, 

(21.8) and next in order in the Italians and Irish and least in the 
Germans. 

Prom another standpoint it is interesting to compare the varia¬ 
bility of the dilTerent traits for all nationalities. This average has 
been entered in the right hand column of Table III. The order of 
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tlic iivei'sige viiriation for LhctiO Len ti'fiits Is ns follows: Leader" 
sliip-26.0, Iliiinor—25.(), Pci’tiiiacity-23.2, FranImcss-21.6^ 
Co(?ljiess-20-7, ObtrusivciicsH-20.(l, Sympa[;hy-18,2, Suspicious-- 
ness-17.7| Gennrosity—Loyiilly—14.2, 

The iiUcrpi'ctiition of Lhc diftercnces in pvcrEi[]:es of the ten' 
traits is not e.isy, It ni/iy indicate a dilFei'Giice in the intrinsic 
vorkihiliy of tlio trnils or ii (lifTorcneo in the case or certtiinty of 
cstimntinif Lliem. Quo tices no iiilicreni rciison why it should bii 
easier for teachers Ln estimiitc Loyiilty of pupils than to estimate 
capacity for LeiKlei'Hhip, IL .seenis to me more probable that Loy¬ 
alty is ii trait in whicli sLiulciUs (in their teachers' opinions) stand 
uniformly niibcr liiKh, and that Loadership is n quality in which 
they show great diver.sity. 

’Dr, iT. Ardiiir Iliinls ('iiIIk riiy flllcndoii to (lie fact tiiiil die DrolKihlc. 
ci’riii's 1111(1 Hill HliiiKluril (Icvliilloiis iipoii \vlilrli Ihey iini Imseil m iirolmbly 
lalliii'ijct'ih 5(0)11' i',\li'iil, 1)}' Die I’lH'l l)i)i|- (lilfi'ri'iit leiR'lieiH riilcil Hio 
(llfCcroiil liKllvliliiiilHi iiml iiiU' sci of Iciiclici'H nilcd ii IfU'Riji' iiroportimi of 
llic Uci'inaii sLiKli'iilH Lliiiii iiiKilliiT si't whicli li'i'iili'il, siiy, ii lurjici* pi'mior- 
lion (if till' Irish, Tliiin iiiiy illffi'i-eiici' In (lie rirrsnniil (‘(iiiiilli)ii of Uicse 
LW) griniiiH (if AyoiiM he I'l'llirlod lij (hr niii|,nilLiuln oC Llic varliihll' 
lllcs, Ilciiiwfnliillvi'H Ilf (he iliaViviit riiccs were, of ctiiu’Ke, tllsu'lliiiied 
finionp 111!' IciicliorH Milhmit, imy ciJiHChMiH soled Inn, SMll il Is ti'iio Unit 
file (fafcreiit (iiili's of caleM did not nilc /in ('(jii/rl ni'eiioi'thin of pf'esoiis of 
llic dlrti'i'ciU iiiilliiiiiill(ii‘H; In iilher ^vonls, Llio ilUl'eroiit sels of rulers did 
ji/if iil/iy /in ('((iiiil iniri In (ll'll'^l 1 ))Jll])^f ihe iirpnipo rn(J)j|' of persiuw bo- 
loiinltiR U) different iiiitliiiiiilltleH, This Inliodiu'es ii [ui'Llioi' errnr which 
wniilil only lie iivercoiiie when liirKer iiiuiiliei's oF sUiilonta lire riited, 
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A CONTRIBUTION TO THE TECHNIQUE OP 
PARTIAL CORRELATION 


By C. I.- IIUFFAKEU 
State University of lowii 

It is well vecoguized that the partial regreaaion cciuation is the 
best tool for the study of many cdncalioiml prohlomH. This is 
particularly true if the problem involves (3) tlic analysis of a 
"general ability" into its component specific abilities, or (2) the 
determination of the diagnostic value of difrerent tests. In the 
schema developed by Yule‘ tbe computation becomes very compli¬ 
cated and laborious if the number of variables is nt all numei-oiis, 
Methods of shortening the labor have been devised by Kclley“ and 
RosenoV. The schema devised by Rosenow rcc\v»ive3 only about 
half the labor of that of Kelley, but il has the very important 
shortcoming that the signs of oil but two of the highest order 
coefficients are indeterminate. It necessarily follows that the 
signs of all the regression coefficients are indetcrminnlo except 
two. This shortcoming imposes a seidous liniitnLion on the use¬ 
fulness of Roseuow's schema. Both plans referred to above, inalce 
use of the fact, that usually the solution of such problems as have 
been indicated before requires only one regression cciuation, 

The witer has devised a schema for solving problems in partial 
regression which involves the finding of fewer coefficients than 
either of the two plana cited before rmd at the sanie time avoids 
the approximation of Kelley's plan and the indeterminate signs of 
Rosenow's plan. 

NmruRu OP coRppiciiiiNTS ni-iQUinnD* 

Variables This plan Yule Kelley Rosenow 
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This plan is outlined below. In the outline it is assumed that 
the reader has a working knowledge of the theory of correlation 
and of the notations of partial correlations as given by Yule. 

The general problem before ua is: given a dependent variable 
and a number of independent variables how can the maximum of 
information be obtained with the minimum of arithmetic? This 

'Yule, G, Undy: dii Iiitroiliiotlon to the Theoru of RiaUstica, 1030. 

/Kelley Truiiifin L.: Ghart la Facilitate the Oaloiilutlon of Partial CoclII- 
clciita of CoirelflUoji amt itenyeaslon RptinliDnSj lOai. 

Tf t Analsals of Uental FuHeliona, Psych. Moiioffrnplifl, 

V'ol. WIV, No. C, 1D17, 

'Miimlior ot coemeloiilB nooded Tor KDlley'e and Uosenow's pinna la from 
BOHcnow op.clt. 
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pvoblem may be divided into two sub-iiroblems which are succes¬ 
sive stages of a single operation. The two stages are: (1) The 
finding of the coelTicicints of partial correlation, with reference to 
the dependent variable, of the highest'order; (2) The finding of 
the coefficients of regression (weights) for estimating the depend¬ 
ent variable. 

In n problem involving four variables, the tables given below 
include all the partial correlation coefficionts of oil orders needed 
for findiiiB the coefiicionts of the highest order with reference to 
the dependent variable. 


Ji'lTHt UldlT 

Miiy 

y.i'To 

lie nlilnIniMl 

from 


Order CuL'IllclfHU. 

r 

T 

r 

r 

12.-I 

12 

11 

24 

r 

r 

r 

r 

r.i .2 

13 

12 

23 

r 

r 

r 

r 

13.4 

13 

11 

31 

r 

r 

r 

r 

1-1.2 

11 

12 

24 

r 

r 

T 

r 


23 

24 

34 

r 

r 

T 

r 

31,2 

31 

ai 

21 

.Sucond Onlcr 

Mnv 

liR niiUiliiQil 

from 

C.’iK'llioli’iUa 

Flrsl 

Order Cuufllclcuts. 

NoL'rtotl 

r 

r 

r 

r 

12.3-1 

12,4 

13,4 

23,4 

1’ 

r 

r 

j- 

13.21 

13.4 

12,4 

23,4 

1' 

r 

r 

r 

14,23 

11.2 

1.3,2 

31,2 


The regression equation to be used in esUmating the dependent 
variable ia. ^ ^ 

1 12.3t 2 a 14.23 i 

In which X, is the estimated deviation from the mean of variable 
1; Xz observed deviation from the mean of variable 2 etc. 

In addition to the coefficients given above the four standard de¬ 
viations of the typo <^1.234 will be needed. Each of these may be 
found in threo di/Teroiifc ways, for example ^1.234 m.ay be found 

from: 22222 

a =ff U-r Kl-r Hl-r ) 

1.234 1 13 13.2 14.23 

2 2 2 2 

= 0 - (l-r la-r la-r ) 

1 14 13.1 12.34 

2 3 2 2 

=ff (1-p )(l-r )(l-r ) 

1 13 14.3 12.34 

It is now possible to select formulae for the standard deviations 
needed in such a way that all the coefficients used occur in the 
tables of partial coefficients given above. The formulae selected 
il this MSO a«: = )(l-r- ) 

1.234 1 12 13.2 14.23 

* 1 ) 2 2 *’ ^ 
ff" =a (1-r Hl-r“ )(l-r" ) 

2.134 2 24 23.4 12.34 
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2 2 2 2 2 

a -<f (1-r Xl-r > 

3,124 3 »1 23.4 13.24 

t) <> o o Q 

(t" =ff"a-r“ Xl-r" )(l-r ) 

4.123 4 24 ai2 - 14.23 

As a checlc on the arithmetic of the opcrntion, it ia well to find 
multiple R in two dilTerent wnys, namely by 

l-R = 0 - d-r" )(l-r“ )(l-r" ) 

1{234) 12 13.2 14.23 

2 2 2 2 

1-It (l-r >(l-r )<l-r ) 

1(234) 14 13.4 12.31 

This furnishea an absolute check on all the woi’k except that of 
ria.si and the coefficients that are used in findiiiff it are checked 
for their accuracy. There is no check on the arithmetic of the 
stand deviations included in the plan. However, if a check ia de¬ 
sired, they may be found from the following equations, after r,,., 
has been colculated from r>«, rii, and tji. 

2 2 2 2 2 

ff -V (1-r )(l'r )(l-r ) 

1.234 1 14 13.4 13,34 

o 9 2 ^ 

i ~a (1-r )(l-r" ) 

2,134 2 2;i 24.3 12.81 

Q 2 2** ** 

(T ~a (1-r )(l-r" )(I-r" ) 

3,124 8 23 31.2 13.24 

2 2 ** 2 

a ~a (1-r Hl-f )(l-r ) 

4,123 4 31 24.3 14.2:i 

In using this plan it should be held in mind that the different 
partial coefficients are obtained from the column headed “May bo 
obtained from" by substitution in the gQiieral formula 

r p .r2n . 34 .. (n-1) 

^ _ 12.84 ■ (n-D- ln.34 ■. (n-t) _ 

12.34 , . -n I- 1 - 


I i-r 


ln.34. , (n-l) 


2n.a4-,. (n- 1 ) 


» V 

In each case, the first coefficient given becomes the first term of 
the numerator and the second and third the product-term on the 
numerator. The second and third coefficients likewise appear in 
the 1-r’ of the denominatOT. For example: 


r - r . t 
12 14 24 



./ 2 . 

/ 2 

\ fl-r -4 

. |l-r 

V 14 ’ 

V 24 

P - r 

r 

. _ 12,4 13.4 

23.4 
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The i^egression cocflicients arc obtained by substitution in the 
general formula 

b =r \234...n 

12.a4..n 12.34..n- 

Por example bii.n and bn.ji arc given by the formulae 

It =r \2.U 

12.34 12,34- 

a 

2.134 

ti =r ‘^1.234 

13.21 13.24- 

cr 

3.124 • 

Por five vflriflblea the equation becomes 


X =lj X +b X +b X +b X 
1 12.343 2 13.243 3 14.233 4 15.234 


5 


and nmy be solved by the following outline using the same checks 
given for four variables, ofler extending them to include the extra 
variable. 


Fist Order May be obtained from 

Gocincienta Zero Order Coefficients 


Needed 




T 

r 

r 

r 

i 2 .r> 

12 

16 

25 

V 

r 

r 

r 

18.2 

13 

12 

23 

r 

r 

r 

r 

13.5 

13 

15 

35 

r 

r 

r 

r 

14,2 

14 

12 

24 

r 

r 

r 

r 

14.6 

14 

16 

45 

r 

r 

r 

r 

16.2 

16 

12 

25 

r 

r 

i* 

r 

23.6 

23 

25 

35 

r 

r 

p 

r 

24.6 

24 

25 

45 

r 

r 

p 

r 

34.2 

34 

23 

24 

r 

r 

p 

r 

34.5 

34 

36 

45 

r 

r 

r 

r 

36.2 

35 

23 

25 

r 

r 

r 

r 

46.2 

46 

24 

26 
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Second Order 
Coofricienta 
Needed 


May be obtained from 
I' irat Order Coefficients 


*^12.4C 

j* 

*12.5 

*^14.6 

*24.6 

13.4B 

p 

r 

13.5 

*^14.5 

*34.5 

14.23 

14,2 

*^13.2 

*34,2 

*^16.23 

*^15.2 

*^13.2 

*36.2 

^23.46 

23.0 

*^24.5 

*34.5 

"^45.23 

4G.2 

*35.2 

*34.2 

Third Ordex’ 
Coefiicientg 
Needed 

May be obtained from 
Secojid Order Coeflicients 

"^12.345 

^2.45 

*^13,45 

*23.45 

^13.24B 

*13.45 

*^12,45 

*23.45 

^14,236 

p 

14.23 

’^15.23 

*46,23 

15.234 

16.23 

*14.23 

*45.23 


The formulae lor the stnndard deviations are 




4.r.34=V'-4> “-4.s><^-4 e3> "-4 .3*’ 

T’ormulae for the b's are 


b 

32,iHo 


ffl.SJIrl 

12.3i5”ff2.i;Rj 


b 

13,2-15 


cl. 23.15 

r _ 

13.215 tj3.12-l,j 
etc. 
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The eqiintion for six yrtriftblc-s is: 

X=b X -hh X -H> X +li X xl» X 

1 2 :i n.‘jnnn .-i 15.25^0 s lO-sajn a 

The plfin for six variables is Kiven below and is subject to the 
same chcch.s ti)L> problems with a smaller iiuinbcr of variables, 


Fist Order 
Cocfnciciita 

Koedeil 


Maybe obtained from 
2cro Order Cocfliclonts 


r r r r 


12.G 

12 

16 

26 

r 

r 

V 

r 

13,2 

13 

12, 

23 

r 

r 

r 

r 

13.fl 

I'd 

10 

36 

r 

»■ 

I 

r 

14,2 

14 

12 

24 

r 

T 

r 

r 

14,G 

14 

1C 

46 

r 

r 

r 

r 

1C.2 

15 

12 

25 

r 

r 

r 

r 

15.0 

U 

1C 

66 

r 

V 

r 

T 

1C.2 

16 

12 

26 

r 

V 

t 

T 

23.G 

23 

20 

36 


r 

r 

t 

24.0 

24 

2G 

46 

r 

r 

r 

t 

26.0 

25 

26 

50 

r 

r 

r 

r 

34,2 

34 

23 

24 

r 

r 

|. 

r 

34,0 

34 

3b 

46 

r 

r 

r 

t 

35.2 

35 

23 

25 

V 

T 

r 

t 

35,0 

35 

36 

56 

f 

r 

r 

r 

3C.2 

35 

23 

26 

r 

r 

r 

r 

45.2 

45 

24 

25 

r 

r 

r 

r 

46.G 

45 

46 

56 

V 

r 

r 

r 

4G,2 

46 

24 

26 

V 

r 

r 

r 

5G.2 

GC 

26 

26 

.Second Order 

May be obtained from 

Coefiieients 

First Order Coefficients 

NoedocI 




I* 

r 

r 

r 

12.CG 

12.6 

15.6 

25.6 

V 

r 

r 

r 

13.5G 

13.6 

IB.G 

35.6 
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14.23 

"^14.2 

’^13.2 

’^34.2 

14.66 

'’ 14.6 

’^16.6 

’^45.6- 

‘^16.23 

‘^16.2 

’^13.2 

’^35.2 

16,23 

'^16.2 

‘*13.2 

36.2- 

23.56 

’^23.6 

'^26.6 

’ 35.6 

'' 24 .G 6 

’ 24.0 

26.G 

’^45.6- 

34.66 

’^34.6 

46.6 

*^35.6 

’" 45.23 

’^46.2 

’^35.2 

*^34.2- 

46.23 

’' 46.2 

’" 34,2 

*^36.2 

’"66,23 

'^66.2 

"^35.2 

'^30.2 

Third Order 

May b 

e obtained from 

Coefficients 

Needed 

Second Order Coefficients 

’^12.366 

p 

'^12.56 

’^13.66 

’^23.66- 

12.466 

p 

‘^12.66 

‘^14.56 

’^24.66- 

13,456 

p 

13.66 

14,66 

34.56 

14.356 

p 

14.66 

13,60 

’' 34.66 

15.234 

I* 

16.23 

'' 14,23 

’' 45.23 

16.234 

p 

’^16.23 

*^14.23 

^46.23 

23,466 

r 

’' 23,66 

24.56 

*^34.66- 

24,366 

p 

^24.66 

’^23,56 

’' 34 .60 

66.234 

’^66.23 

’^46.23 

46.23 

Fourth Order 

May be obtained from 

Coefficients 

Needed 

Third Order Coefficients 

12.3466 

r 

^2.466 

’*13.466 

*^23.466 

13,2466 

r 

13.456 

’'l2,456 

" 23.466 

14.2366 

r 

14.366 

12.356 

24,366 

15.2346 

r 

\5,234 

16.234 

"66.234 

113.2346 

’' 16,234 

16.234 

r 

56,234 



Tl'lCHNIQUG OP PARTIAL CORRELATION 


142 


Formulfle for fitnndani deviations, 

2 i 1* 'i: ‘2 -2 i 

^ -ff (l*r )(l-r ){Ur )(l-f )(l.r 

I m 15.!! H.rifl 

I) >) ■) ‘J •! II 

/ =tr"(l r" )n-r“ KLr" )a-T )(l.r‘ 

2,1.'JJ,K1 U JJH n/) ‘MM L'/l.-i-lfl IL'.Wi'fl 

II 2 '2 *i ‘i " 

o' )(l-r )(l.r' )(l-r' 

II ;hi .'Mfi la.-jjra 

li 2 2 i; 2 '> 

ff =tr (l-i- )(l-r )0-r )(l-r )(l.r 

.U'-l:i5i| '1 HI -irMI 'MM iim M,23:1(1 

1) 2 2 2 2 2 ’> 

0 =cr [l-r )(l-r )(l-r )(l.r )|I-r' 

n.viHKi 5 -js :i5.2 -irK^n ]r),2:u(i 

<; >1 •> 0 o I, 

ff =i[U)[U )a.r“ )a'r )(j-r 

ii.i2;ii:i « "(I :i(5.2 - 111 . 2:1 r.fl.2a-i inx 

Formulae for fclic b's are: 


) 

) 

) 

) 

) 

) 


)i - 

i' 2 .:iir>o i 2 .iMri(i a'lnm 


aUMoi} 

U =r - 

i:s. 2 iriii mm aWitan 
etc. 

The same jiltin of selection can be used for any number of vnri- 
^bles with t)io .same proportionate saving of labor. The use of 
Kelley's Chart reforred to before is possible with four variables, 
but is not recommended for more than that number. For five and 
six variables the writer recommends the use of such tables as 
Miner's^ and a calculating machine. By the use of these tables and 
a calculating ninchine it is possible to solve n problem of six 
variables correct to four places in three hours, after the Zero Order 
Coefficients have been found. 


2 

^Miner, 'J'ablca 0 / 1-f OMfl 


^ l-r ** John Ilonhlns Press, IDSli. 


THE RELATION BETWEEN THE INTELLIGENCE; 
AND VOCATIONAL GHQIGES OF HIGH 
SCHOOL PUPILS 


B Y Gustave A. Feingolu 
Hartford Public High School. 


In the vnriod literature on vocolional guidance and vocational 
education, one finds that almost nothing hna been done in the at¬ 
tempt to correlate the vocational choices of high school pupils with 
their montality.*^ Yet if vocntionnl guidance is to be put on a 
scientific as well as practical basis, this is the very first thing that 
should be done. The chief function of the vocational advi.sor in the 
high school should be to save pupils of high jnontnl ability from 
entering occupations of limited opportunity, on the one hand, and to 
advise others of little ability against trying to enter occupations 
for which they have not the intcllcclunl foundation, on the other 
hand. 

In the September 2, 1922, issue of Schciol and Society there ap¬ 
pears an article on Oecupational-Intelligencc-Slandards" whevcin ia 
presented an intGlligenee scale grouping some ninety-six diflerent 
occupations into various Army Alplm scores, based on the results 
of the occupational studios made by the Division of Psychology, 

S. G. 0.; and reported in the now famous Volume XV, Memoirs of 
National Academy of Sciences, 

'With Lhia Oceupational-Intelligencc Scale before us, there was at 
hand a means for comparing the vocational choices of high school' 
pupils with their intelligence grades, in order to deterniino whether 
they overrated or underrated their abilities, and to what exLeirt. 

All occnpational-intelligence scales are based on the as.sumption 
that certain vocations are within reach of coi’tain mental levels, 
One group of vocations is within reach of “A” intelligence, another 
within reach of “C'* intelligence, and so forth. If a high school 
pupil of a certain mental level, “D," let us say, desires to enter a 
vocation which belongs to a much higher level, like "B”, he over- 
estimates his ability by two degrees. The assumption is that he 
will either not succeed in entering hia desired vocation, or if he 
does, the probability is that he will not he efficient in it. On the 
other hand, if a boy expects to enter an occupation that belongs to 
a much lower mental level than his own, the community loses by 
that choice, inasmuch as it docs not get from him the best and 


titles onJ'fte Pai/eMolonu of ToOTUonai Selfc/liin reviewed Uy A. 

Vol. 10 , No. J, 1022, not out! HeeniH to deal Hpe- 
elllcnlly with die above pcoblcm, 

B/flHdsrrii, Scliool iiud Society, 

aTU. 
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utmost sorvicQ that he is capable of rendering, nor will he be happy 
because he will not have the full oppoi'tunity to express his entire 
personality in it. This is nn important matter, for about 60 per 
cent of nil high school pupils make up their minds with respect to 
their future culling even before they enter school, and about 80 
per cent of these cling to their original choice throughout their 
school career. Our pi’oblem, therefore, was to find out to what 
extent liigh school pupils make or express vocational choices that 
are within reach of thcii' mentality. 

To be sure, the alpha scores given for the various occupational 
groups in Fryer's table were attained by individuals whose school¬ 
ing, for the most part, lay from five to fifteen years behind thorn; 
and, in view of the fact that when the youth gets out of school 
he is bound, more or less, to get into n rut of thinking and acting, 
it is inevitable that he should strike a lower score in an intelli¬ 
gence test then, than he would have done when he was at the 
height of his school days.* This is demonstrated by the fact that 
in the relative mental ranks of the various occupational groups in 
the afore-mentioned Volume XV, the “student” is placed third 
from the top, apparently above the physician, above the clergyman, 
and above the accountant, notwithstanding the fact that all of 
those have been students at one time in their lives.^ Consequently, 
a certain amovint of caution had to be exercised in comparing the 
intelligence grades of high school individuals with those of mature 
persons in various occupational groups. For, a high school senior 
may readily score 127 points, which is the average for the physi¬ 
cian group on the Occupational-Intelligence Scale referred to, and 
yet be woefully deficient in mentality for the medical profession. 
In other words, his relatively high score may he due to the educa¬ 
tional increment, which is hound to innure to high school pupils 
of every grade of mentality by virtue of their constant immersion, 
forced or otherwise, in the educational waters.* It was, therefore, 
necessary to strike n group of high school pupils not too long domi¬ 
ciled in the realm of secondary education, on the one hand, and 
among whom there would be found a mental level that would corre¬ 
spond, in points scored, to the mentality of some definite occupa¬ 
tional group in Fryer's scale, on the other hand. 


®Slnci‘ Llio ftbovc wns written MorKorot V. Colilj’a The LUitlls Set to Edii- 
rafh/ne/l .■IrhlciT/Hcnt hy Limticil FnleVfi/cnce, .Tour. Milne. Puy. Vo], XIII 
Xo. U, 1022, lias miulc its apiienrnncu mid from Mic llf^uios prcscatud In 
I'liblL' VIII, (iiu‘ iiiav tnfi’r iliiit tiuiso wlio have bntl only oiia yonr of IilgJi 
sclioiil cilutiUloii. will, lo yours lutov, score soveii points more tlmii they 
(lUl as li\(;h school ri-oHlimon, those who left lilBh school at the eml of the 
sophoninri; .vear will, 3.1 yenrs Inler, .score five pfUntx Io.sh tlnin na eopho- 
nioros, udiil'lK of thvee yenrH' hipli school training will Koore 111 less tlinn 
they illd aw Juniors iiiul those of four yeiirs lilgli sebonl will score 20 polrita 
iGRH ilinn they dlil ns high uchool Beiilors. 

‘ilem. Nnt. Ac Sc. Vol. XV, p. 8HII. . 

“Por suhstnutlatioii of this see Cobb Op. clt. p. 402-lirJ, 
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Now ifc happened thnb in June, 1D22, all prospective Freshmen of 
the Hartford Public High School, eome 1200 in number, were given 
o modified Army Alpha test and the puasiiip mark was set at 70 
points, equivalent to an I. Q. of 103 iind to 50 per cent intelligence 
on our scale of 100. By dividing that scale into ion de.cUes, the 
uppermost, or "A" menlol level, corresponded exactly with the 
occupational groups that fell into the "A’' mentiil level on Fryer’s 
scale. Thereafter, it wna merely iiccessury to draw lines through 
all corresponding points of division on the Fryer scale and note 
whether the vocational choice made by n pupil of n given degree 
of intelligence fell within hia mental level on the converted.scale 
or not. 

In one respect Fryer’s Occupational-Intelligence Seale is unsatis¬ 
factory for high school purpo.aes in that it is not sufTiciently com¬ 
plete ill the matter of vocations. No provision is made in it for the 
professions of law, hanking, jowrnnlism, high school and college 
teaching, nor for teachers of music, gymnastics, and cooking, Yet, 
there must have been hundreds of lawyers, high school teachers, 
college professors, bank tellers, not to mention instructors of gym¬ 
nastics, enrolled in the army. In an intelligence test given to fifty- 
five high school teachers, the writer found that their median on the 
Army Alpha test waa 162 points, with « vnrintion thnt ranged from 
04 to 100. Also, in the occupational studios made by the Bivisioii 
of Psychology, S, G. 0., lawyers are ranked second from tlic top. 
The wi'iter felt justified, therefore, In placing lawyers, journalists, 
high school and college teachers in the '‘A" class on Mr, Fryer’s 
scale. Authors and bankers were placed in the modified “B" group. 
Music, gymnasium, elocution, and cooking teachers, professions 
selected by high school pupils, as well as the indcriniLo profession 
"business", so frequently chosen by high school boys and girls, were 
placed in the modified "D" group. Among girls, those who chose 
di-essmaking as their vocational ambition, wore classified with tail¬ 
ors, and haiT-dressers with barbers. 

Investigations conducted by vaidous psychologists have demon¬ 
strated thnt the I. Q. does not change appreciably. The writer has 
thus far retested two high school classes at intervals of two years 
and has found practically no change in the average I. Q. attained 
by the same pupils as Freshmen, and two years Inter as Juniors. 
Thus, the average I. Q. of 288 Freshmen who ha^d entered the Hart¬ 
ford High School in September, 1920, wns 111; their average age 
naving been 14 years and 6 months, and the average number of 
points scored by them on the writer’s modified Alpha test having 

cclucnllonnl mental Increment wna about n Alplia points. Dodiict- 
liig thnt number from 110 glvea them nn I. Q of 102, This linrnioiilze.^ with 
theory—na the normal Individual upDcoBcUca adwlL inenlnUty bla I. Q. 
Ghoiild Eipiironch 100, 
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been 06, whicli erjuivaJeiil to a mcnta) age of 16 years and 2 
inontlis. Tl)o avcr/iffo number of points scored by these same 288 
pupils in September, 3922, when they became Juniors was 110, 
which is criiiivalenL Ln the mental age of 17 years and 1 month; their 
average I. Q. was consequently lOJ." 

By ntlopling a percenUiBe scale of menliii alertness, the base 
of whicl\ is 152 points, eiiuivalent to 100 iier cent intelligence, for 
high school Freshmen tested three weeks before graduation from 
gruimnar school, and a scale with a base of 172 points for Sopho¬ 
mores, one with u base of 18G points for Juniors, and one with a 
base of 196 points for Seniors, the latter three groups tested at 
the beginning of their class careers, the writer has found but little 
displacement from one mental level to the other as the pupils 
progressed from tho Freshman to the Senior year and were sub¬ 
jected to two separate tests. 

Thus, tile average per cent of intelligence for the above men¬ 
tioned 288 pupils, rated by their Freshman scores, was 59.0, and 
their average intelligence two years afterwards, rated by their 
Junior scores, was 02,3. The coeiiicient of correlation between the 
Freshman and Junior scores was +.875±.009. Fifty, on a scale of 

100, being the minimum requirement for passing our high school 
intelligence test, the corresponding passing I. Q.’s for the Fresh¬ 
man, Sophomore, Junior, and Senior classes are, respectively, 103, 

101, 98, and 95. The following table gives the points scored, per 
cent intelligence, and letter grade for each mental level in the four 
high school classes. 

TABLE I. 

COMP All ATIYE INTICLLIOENCK SCALES FOR HIGH SCHOOL 
CLAHSF.S. 


(To be nppllofl lo Mic Iflsl Ibroc nt tlic bof^Jiinbi^ of MicJr cinss careers) 
POINTS .SCOKBD 

Fresh- Sopho- Letter 

men 

mores 

Juniors 

Seniors 

% Int. 

Grade 

137-152 

165-172 

167-186 

176-196 

90-100 

A 

121-136 

138-154 

148-166 

166-175 

80-80 

B 

106-120 

120-137 

130-147 

136-165 

70-79 

C 

91-105 

103-119 

111-129 

116-135 

00-69 

D 

76-90 

86-102 

92-110 

96-116 

50-59 

E 

61-7B 

69-85 

74-91 

76-96 

40-49 

F 

45-60 

68-68 

65-73 

56-75 

30-39 

G 

44 & Less 

61 & Less 

54 & Less 

65 & Less 

29 & Leas 

H 


If now we take Fryer’s Occupational-Intelligence Scale, modified 
so aa to include the professions frequently chosen by high school 
pupils, and then group into the various mental grades the profes¬ 
sions that naturally fall into them by virtue of the average points 
scored by the members in each group, we obtain the following Oc- 
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cupatioTinl-IntolIigcnce Scolc ospccinlly ndaptotl for school 

pupils,-nnd, though bused on the iiilclligciicf {ichiuvonients of high 
school Froslunen, is none the less npidicnhlo to upper clnssmen, 
when attention is paid to the letter grade In jnenliility instead of 
points scored. TABLE II. 

OCCllI*lV^lC)N‘\.L•I^^'i’KtJI•l^^KX^■l'5 KOU l[H}|[ SCUPOL 





IT 


Letter 

Av. 

Av, No. 


Grftdc 

I. Cl,’ 

Points 

Occuimtinn 


1C2' 


Teacher (College & High) 



161 


Enpincor (Civil it lilccli.) 

A 

12C 

? 

Ml 

Lawyer 





Joiiniali.st 



152 


ClcTRyman 



197 


AccoiiiititiiL 



127 


Phj'.siciiin 



•} 


Novcli.st 

B 

122 

122 

. 126 

Teacher (Grades) 





Banker 



119. 


Chemist 



114> 


DraClsmau 

C 

116 

111 

110 

Secretary (PrivuLe &; Institutional) 



110 


Dcnliat 



109, 


Executive, minor 



103 


.Stenoprupher & Typist 



101 


Bookkcciicr 



99 


Nurse 



06 


Clerk (otTicc) 

D 

110 

91 

06 

Clerk (I’Qih’oad) 



V 


"Business” 



0 


Gymnasiiim Teacher 



9 


Gookinp Teacher 



9 


Music Teacher 



9 


Elocution Teacher 



86 


Photographer 



85 


Telegrapher & Radio Operator 



82 


Musician (Band & Orchestra) 



61 


Artist (Sign IjetteTer) 


103 

81 

80 

Clerk (Postal) 



81 


Electrician 



80 


Foreman (Construction) 



78 


Druggist 



77 


Foreman (Fnctoi'y) 


■’DcrU-eQ Irom the Preslinien scores ond nges lii eiicli group. 
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70 " 


Telephone Ojierator 

r/j 


Carpenter (Ship) 

GO 


Policeman & Detective 

Oft 


Auto Assemblur 

07 


Tool fllaUer 

OR 


Plumber 

OR 

05 

Lath Ilnnd (Production)' 

OR 


Auto Mechanic (General)' 

OR 


Auto Chauffeur 

OR 


Tailor 

V 


Di'c.ssninkcr 

•} 


Milliner 

G3 


Macliiniat (General) 

G2 


Actor (Vaudeville) 

GO 


Printer 

GO 


Carpenter (General) 

09 


Painter 

58 


Farmer 

08 

55 

IJrick Layer 

57 


Cntex'er 

G5 


Dnrber 

V 


Hair Dresser 

02 


Sa)e.s Clerk 

401 

1 

Hospital Atte'ndent 

32 

1 35 

Snilor 

31 

1 

Structural Steel Worker 


Not nil of the oceu))ationS5 given in Fryer’s scale are included in 
this inodiHcd one. Only Uiose which were chosen at least once 
among the 512 pupils who expressed their vocational preference 
are given a place in it. These are printed in heavy type. The 
remaining occupations are included as ones which the writer 
thought high school pupils might possibly choose, at least tempo¬ 
rarily; also in order to serve ns a means of comparison between 
the different types of vocational mental levels. 


Let us nov/ see what the 512- high school Freshmen actually did 
in the matter of choosing a vocation or indicating a vocational 
preference. Table III shows the degrees and the direction of vari¬ 
ation of vocational choice from mental level among the 250 boy.s, 
The numbers -|-6, -h4, -|-3, etc., repi’csent the number of mental 
levels, above that of the individual, wherein lay the vocation he 
chose. Minus one, —2, etc., indicate the number of mental levels 
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telow that of the individual wherein lay the profession he selected, 
The letters in the squares show in whaL inciilnl level lay the voca¬ 
tion chosen; the numbers in the squares ropre.sent the number’ of 
pupils making' that choice. 

The .above table snows some astonishing results. There is a 
conspicuous tendency for the superior pupils, Lho.se of “A” and 
“B” mentality, to underrate their ability and to choo.su n profes¬ 
sion that falls in a mental level considerably below their own. 
And there is a still gi'eater tendency for pupils of low mentality 
to choose profc.ssions that lie considerably above their mental 
levels, To be sure, the choosing of a profession that lies within 
one mental level above or below the one to which a particular indi¬ 
vidual belongs is no serious mistake. It is perfectly safe to assume 
that an individual of “B” menUdity is quite able to pursue si pro¬ 
fession that Mes In the "A” menial level, provided he puts forth 
enougli industry. Likewise, there is no reason to suppose that a 
pupil of "C” mentality is throwing his future away entirely merely 
by choosing a profession that belongs to the “D” mental level, 
Therefore, in the treatment of the data presented in Tables III and 
IV we shall consider all individuals who vary but one degree in 
either direction n.s having made a proper vocational choice. It is 
only those whose vocational choice lies within two or more mental 
levels above or below their own who will be considered ns not 
having chosen wisely. 

With this proviso before us we find that of the thirty superior 
boys only 20, or GG.G per cent, make a proper choice, whereas 33.3 
per cent choose some profession that requires far less ability than 
they possess, as judged by the intelUo^ence tests. Of course, for 
the "A” pupils, there was no alternative but to choose a profession 
that bay either within their mental level or in some lower level; but 
why should three of the four "A” boys choose vocations that are so 
far below their own mental grade? The "B” pupils seem to show 
somewhat more courage, as well ns more wisdom, than the “A” 
individuals, in choosing their vocations; inasmuch as 73 per cent 
of them select vocations that fall within thoir mental capacity. 
Among the boys of “C'* ability only 44 per cent seem to make a 
proper choice, while the number that overrate thoir ability is 
twice ns large ag those Avho underrate it. When we come to those 
who failed in the intelligence test's, having scored a grade of “F" 
and lower, which is equivalent to 76 points and less on the Army 
Alpha scale, we find that no less than 88 per cent of them select 
professions that are anywhere from two to five mental levels above 
their own. 

To be sure the claim may be made, and justly too, that the so- 
called professions lie within the three highest mental levels, and 
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inasjnucli as tlic very presence of boys in liie’li school already 
iiidicales a leaning toward some profession, it is only natural that 
they sliould tend to overrate their ability, as jndg-ed by their voca¬ 
tional preference*, rather than to underrate it. But this simply 
shifts the argument back one step by taking the problem out of 
the high school and placing it within the grammar school and home. 
It merely nioaius that American cliiMrcn lend to overrate their 
ability even before they gel into high school. Judged by the large 
proportion of high school failures, it being .something like 60 per 
cent, one must say that the above statement is not far from being 
accurate. Moreover it is significant to note that among the mental 
failures a larger proportion, fully 48 per cent, choose a profession 
that lies in the "A" and "B" levels than fio the pupils of either 
“E” or “D" ability, the percentages of excessive vocational over¬ 
reaching in their cases being 40 and 42, respectively. In other 
words, the distribution table plainly shows that the lower an indi¬ 
vidual stands in mentality, the higher seems to be his vocational 
ambition. Whether this is a manifestation of compensation, the 
desire filling the gap within the mind, or whether it is simply a 
further indication of poor judgment and inability to envisage the 
future in matters practical as well as ideal, is a topic for separate 
discussion. 

Nevertheless, there is sufTicient evidence at hand to indicate that 
it is the latter and not entirely the foiuner. Investigating the pro¬ 
portion of pupiLs in the various mental levels who survived the 
high school curriculum for at least two years, tlie writer has 
fouiul that in the Hartford Public High School fully 73 per cent 
of those who fctil in fateWigence at the beg'iniimg of thefi’ Ft'eshman 
year do not succeed in becoming Juniors. Either they drop out 
of school altogether, or vcmaiii in a lower class because of poor 
scholarship. According to Cobb,® 87 per cent of the Freshmen who 
score below 77,5 points drop out before the Senior year in the 
Michigan high schools, and in Madsen's group about 84 per cent 
of such individuals drop out. Now, in view of the fact that the 
professions within the "A” and “B" groups require considerably 
more than mere high school training, it is quite obvious that of the 
thirty-seven “F" and "G" mental level pupils who selected profes¬ 
sional occupations foi’ their career, practically three-quarters of 
them will not proceed far enough in higher training even to come 
within roach of a high school diploma. Once more according to 
Cobb, only about 4.5 per cent of them may be expected to enter 
collegG.® 


"'J’/it' l.liiiil .VR/ to Udiiriilittnal .Li-lilcvemciit by lAniilcil IiilcUttjeiwc, Jour. 
Eilii. I’sy,, V<»1. XVIII, No H, a- UM. 

‘'Op. cil. Talilc IX, p. H59. 
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TABLE III. 

DEGREE AND DIRECTION OF VARIATION OF VOCATIONAL CHOICE 
FROM MENTAE^ LKVEL AMONG BOYS. 




■upii 


Total par caai 
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To judgp by the professions these 250 boys wish to.oiter, we 
muy sny Unit Ion per cent overrate their ability by five mental 
levels, eig-lib per cent ovci-rate tliomaelvo.s by foui- 2ne3itnl levels, 15 
per cent by three niental levels, aiul 1-1 per cent by two mental 
levels. In Ijricf, <18 per cent of all the boys overrate their ability 
by choosinp; a ])r(>fossion that Hos in a mental level that ia from 
two to five ^riulca above their own, Porty^tbree ami two tenths 
per cent seem to choose wi.sely, in that the profession they select 
lies within a mental level that varies only one (IcKree from their 
own. Eipht and ei{?ht tenths per cent underrate Ihoir ability by 
choosing a vocation that lies in a mental level which is two or 
nmre gjmclcs below theirs. The cocllicient of correlation between 
the inlelligonce and vocntionnl choices of these 250 boys is 
+ .0-15 Practically zero. 

Fryer’s OcenpaLioiial-Iiitellieence-Scale does not lend itself very 
readily for the clnssificiition of girls in the saino maiiner ns 
boys, for the very good reason that the occupations considered 
are chiofiy those for men. Nevertheless, it contains the profes¬ 
sions of teacher, sLonographor and tyihst, bookkoopor, nurse, and 
clerk, which constitute nearly 90 per cent of the professions 
selected by high school girls. By including the professions of 
music, cooking and gyinnaBium teachers with the class of boolc- 
keepevB, mirsc'j and BtenographevR, u-s we have done, we have, it 
seems, nnulo provision for pr.'icticiilly every profession that a 
high school girl Avonld be likely to choixsc. ’With these additions, 
we wore surprised to dioeovei’ that of the 202 gb'ls, who indi¬ 
cated their piofcssional choice, only one selected a vocation for 
which no provision could be made on this modified Occupational 
Scale, and that one was acting, presumably in drama. Tabu¬ 
lating the girls in the same manner as we did the boys, we obtain 
Tabic IV, which shows the extent and the direction in which their 
Vocational choice varies from their mental level. 

The similarity in the distribution curve for boy.'; and girls is 
reanarkablc. Here, too, we find that 45.8 per cent of the girls 
overrate their ability bj' choosing vocations that lie within two 
or 3noro mental levels above their own. Forty-eight and one 
tenth per cent jnalce n proper choice and 6.1 per cent underrate 
themselves. T’he coefficient of correlation between intelligence and 
vocational choice for the girls is -I-.0987 ±.041. In spite of the 
fact timt the scale was based on vocations pursued by men, wo 
find that it is applicable to girls, and, indeed, girls seem to 
choose thoiv vocations a little more intelligently than do the boys, 

Before summing up the results of our study, wo must once 
more forestall the probable objection that the reason why these 
pupils tend to overrate themselves by choosing vocaLiona that 
lie so high tibove their own mental levels is because thei)' iu- 
telligcnce has been judged too early in the stage of mental de¬ 
velopment, There is no ground for such criticism. First, be- 
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cause the average mental age ol tUcse pupils was l.j yeai's aad 
G months their averuRe I. Q. 107. Thi.s is coiisidci-ubly higher 
than the average mental age nnd I. Q. for the Americsui popula¬ 
tion aa a whole. In the second place, the "A” mental Ri-oup o£ 
these pupils coincided exactly with the "A" Rroup on the Occu- 
pationnl-Iiitelligence Scale in the iiuiiihcr o[ Alpha points scored, 
None of the deciles in the higher cUiasca could b« so coxnpcii'cd with 
the mental groups 017 Pryor’s OccupnLiomil-InLolligonco Scale. 
Thirdly, an intelligenco test given to 105 evening high school 
pupils, all of whom wore etammur schofil gruduateK, same of 
them being college graduates, some grnnimnr school teacheva, 
one professional nurse, three mnehinists, and ino-sfc of the others 
time-keepers, booldceopevs, stoi'o dorks, and oflke dorks yielded 
an average score of 90 points, which ia only live points above the 
average for the 512 high school Freshmen considered in the 
above tables. Fourthly, the average iutcllicrucc of our “D" 
group (05 ]Joints) is about equal to that of ndults who had one 
year of high school training nnrt wore Ic.^Lcd lb years later.'^ 
The average of our "G” group is equal to that of udiilts who had 
gone through Junior year in high school ami were tested 15 
years out of school. The average intelHgeneo of our "B” group 
is higher than the average intelligence of adults wlio had been 
graduated from the high school or who had hotMi college frc.s'i-. 
men and were te.sted 15 years lalcr. With rc.spect lo the "E” 
pupils, investigfitiouB have thus far shown lliat not move than 30 
per cent of them succeed in hccoining high school .senior.^. 

CONCLUSIONS. 

The above study leads to the following conclusions: 

First: Only about 46 per cent high school pupils make 

proper vocational choices—choices tlial can be realized hy LViom and 
which they will pursue with maximum satisfaction and efiiciency, 

Second: About the same number, 47 per cept, make vocational 
choices that lie considerably beyond their mental reach. Pre¬ 
sumably, this proportion of pupils will eithor not gain their de¬ 
sired vocations or, such as do, will not be entirely efliciejit in 

Third: Approximately 7 per cent underrate their ability by 
choosing vocations that lie considerably below their own mental 
level. 

Fourth: It would seem advisable, therefore, that the first 

duty of the high school vocalionnl guide or vocational educator 
should be to acquaint hitnself with the intelligence of the 
pupils to whom he would give vocational advice. 

Fifth; Viewed from the social standpoint it cannot bo said 
that the American youth is devoid of ambition. He may not 
ahvay.'i put forth the necessary effort to realize his aim, but, 
judged by the goal that he sets for himself, he certainly has far 
reaching desires. 


Oil. (lit. Tablis S, IflO. 



IIELATION OF MENTAL ALERTNESS TEST SCORE 
TO POSITIONS AND PERMANENCY IN COMPANY 

By Marian A. Bills 
Burciiii of Personnel Rescai’ch. 

Curnceic InsLitutc of Technology, 

Three yeara iigo the Bureau of Personnel liesearch Carneg-ie 
Institute oE Technology, giive a mental alertness test to a large 
clerical force. The total results were made practical use of by 
the firm. The experiment described below is simply a by-product 
of thnt investigation but bolds, we believe, several points of 
interest. 

From the tG.st .scores of the entire clerical group those of a 
Jiundrocl tliirty-tlirce individiial.s working at live distinct jobs, 
were drawn off for special study. These five jobs wove chosen 
for three reasons. (1) The jobs were all individual jobs, none 
of thorn involving supervisory duties. (2) They rupro.centcd five 
distinct levels of difficulty of work. (3) A .siifiiciently large 
minibcr of individuals were working" at each of the five jobs, so 
that an average would have iiicaning. 

Thirty months later the subsequent history of thewo one 
hundred and thirty-thi'ce individuals was studied, as'regards one 
fact, were they .still on the job? This gave us a perfectly objective 
criterion,' 

TIig date thus obtained wns .studied with the following questions 
in mind. 

(1) Is there a relation between positions in the company and 
mental alertness score? (2) Does a natural selection take place 
with time that makes this relation more evident? 

We would cMpect natural selection to take place in two ways, 
First by the persnns making low .scores in the mental alertness 
test being unable to handle high grade work and leaving and 
second by persons making high scorc.s in Ihc mental alertness 
test becoming dis.satisfiod with low grade work and leaving. That 
is at the end of two and a half years, we would expect that the 
average mental alertne.ss score of those remaining in the high 
grade job^ would bo Iiig-hcr than the average of tlie original 
group. And that the average score of tho.se remaining in the 
low grade job.s would he lower than that of the original grovip. 
In short, if mental alurtne.ss is a prominent factor in clerical 
work, we would expect the groups to become more di.stincL when 

‘In iliiw cnniininj' n«* clcIliiUe prinmilor riillnv .«yKt'‘ni liinl Ofcn 
worNctl tiiii iiiiil |irniiii>liniis or vudiigH woiiUI liuve Ijcni tuD liuldiiilic a 
cviU’vloii In iiiivn hni-u vi.scU. 
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only lliQse persons arc considered tlnil rcnifiiii in tlic Ki’onp more 
til an two and n half year s, 


HKSULTS. 

The correlation heLwoon the inontnl alertness .score and the 
level of difTicnlty of work performed by Liu- iiulividiuil was for 
the original group H-.22, for the group rcmiaining after two and 
one-half years -l-.'ll. That in thirty nvmths vaiscil the correla¬ 
tion 19 points. 

In order to study the ofl’cct of natural .seleeticm in more detail, 
we have split each grade into three, classes: (1) Thn.sc scoring 
above 110; (2) Those scoring between 8l)-110; (d) Those scor¬ 
ing below 80, The dividing score.s cho.sen arc arbitrary but were 
taken because they seemed from the distribution of ca.scs to bo 
iinturnl breaking points. lufccresL cenlcr.s around groups one and 
three. Group two contains about 2") per cent of the ctise.s and may 
be considered a neutral group. Wo have leLLered Llie (ivc jobs 
from A to E, A being the least diHir.ult jub, 13 being more dif¬ 
ficult than A, and less dilliculL than C, and E being tlie ino.st 
difTicult job. 

The following two tables give tlic data for (1) the original 
group and (2) the group remaining after two and one-half 
years, 




ORIGINAL 

4 GROUl'. 


Grade of 

No. in 

Median 

Per cent scor¬ 

Per cent scov 

Work 

Grade 

Score 

ing over 110 

ing nndor 80 

A 

16 

85 

26 

50 

B 

15 

77.5 

20 

53 

C 

24 

105 

45 

S3 

D 

56 

103,5 

46 

30 

E 

22 

118.6 

50 

13 


GROUP REMAINING THIRTY MONTHS. 


•Grade of 

No. in. 

Median 

Per cent 

Per cent 

Per cent 

Per Cent 

Work 

Grade 

Scores 

scoring 

scoring 

turn¬ 

turn¬ 




over 110 

under 80 

over for 

over for 






those 

tho.se 






scoring 

scoring 






over 110 

under 80 

A 

7 

07.6 

0 

fj? 

100 

37 

B 

6 

80,0 

0 

50 

100 

02 

C 

11 

95,0 

27 

3G 

72 

50 

D 

26 

111.0 

51 

23 

53 

58 

E 

IS 

123,0 

57 

7 

41 

GO 
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The followinf? points would seem to be noteworthy. 

(1) In the original group the median stores of the grades 
range from 77.5 to 118*5, fovty-ouc points, There are two in¬ 
stances where a lower grade job has a sliglitly higher median 
score than the next higher grade job. In the gronj) remaining 
thirty months the iiiediun scores of the grades range from 67.5 
to 123.0, 55,5 points. Each grade shows a higher median than 
the grade below It. 

(2) In the two len.st difficult jobs A and B, m one scoring over 
110 has remained. In the C grade a smaller per cent of the 
remaining than the original group have scores over 110, while 
for the D and E grade, a larger per cent of the remaining 
group have scores over 110 than of the original group. 

(3) Almost the opposite holds when we consider the group 
scoring below 80. Thorc iS' a steady decrease of the per cent 
scoring below 80 with the rise of the grade of work. There is 
also with one exception an increase in turnover in this group from 
A to E. 

Those YcsulU are as a whole confirmed by a study of 330 other 
cases from the same firm where many jobs were lumped together 
as being of the same difficulty and the grading was much less 
■carefully done. On account, however, of the inaccuracies that 
wo know entered into the grading, we do not believe the results 
jire worth quoting in dclail. 



A STUDY OF THE CORRELATION OF COLLEGE 
STUDENTS’ ESTIMATES OF INTELLIGENCE 
WITH THE OTIS TESTS AND OTHER 
SCALES 

By J. U. Yahbrough 

Cni'noffiG Instituie of Technology, Pittsburg, Pa. 

It is a matter of common observation that eoHogc sUidcnta 
select certain of tlieii* number to ilesignate us .superior, Tbright, 
and intelligent; and ju-st as fi'cciiieiitly do they select others from 
their group and call thorn inferior, stupid, and dull. Each 
student soon after entering college l.s thus tacitly iiasigned to his 
group by his fellow students, and Ihcreuftcr student conduct 
toward him i.s in accordance with this a.ssigmncnt, regardless of 
the method through which or the circumstances under wliieh the 
judgment was formed. After observing this practice of niore or 
loss unavowed placement by sliulcnts in some of our largest 
Universities, and finding it to be as common as in our smaller 
Colleges; and Loo, after observing the certainly with which u 
group of students act toward n fellow student when once it has 
placed liim intellecLually, the witer .set about to devi.sG some 
scheme for testing the accuracy wLh which college students place 
their fellows in the scale of iiitelligeiice. 

lu order to make this test the judgments of a group of college 
students wore secured and nnalyzotl. The criteria used by each 
student in estimating the ability of fellow students were listed in 
terms of human traits. These traits wore u.sed as a basis for 
rating all members of the class, This final rmting of the students 
by the class was correlated with the rating on the basi.s of their 
score on the Otis Test, instructor’s estimate, and college grades. 

METHOD OF ANALYZING THE STUDENT’S JUDGMENT. 

The student,s used in this experiment were of junior and senior 
rank, They were in a small compact college wlicre the sbudenta 
were brought together doily in their school routine; where, in fact, 
the success of the existing system of student self government 
depended largely upon this close contact. Moreover, they had 
been associated in this class in psychology for a period of six 
months and had full opportunity to observe each other in class 
discussions and work in general. Their work in this class had 
been in general psychology with no special emphasis placed upon 
the topic of intelligence. 

These thirty students were provided with paper and pencil and 
without any foreknowledge of the content or purpose of the 
experiment were asked to answer the two questions given below as. 
the experimenter dictated them: 
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1. Do you make it n habit to rate one of your fellow students, 
A as intelligent and another student, B, as stupid? 

2, Enumerate the six human traits which you most fveciuently 
use in rating your fellow students. 

After question 1 was given anti the answers were written on the 
paper provided, the second question was dictated, The students 
were told to use all the time they wanted, but to write down the 
traits as vjipidly as they thought of them. Each member of the 
class was requesLotl to prepare hia list without communication 
with other members. This request was diligently observed. At 
the end of twelve minutes all students had completed their lists, 
and were very anxious to i-eport and hear others report. Each 
student desired to know whether or not his list if six human 
traits had been partially or wholly reproduced by some other 
member or members of the class. 

Student No. 1 was called upon to place on the board before 
the class the list of six human traits most frequently used by 
him in judginp^ the intcllieence of his fellow students. 

Student No, 2 wjus asked to ndd to the list on tlie board any 
trait or tvait.s from his list of six which were not mentioned 
by Student No. 1. Thus we proceeded thvough the entire class. 
Should each .student use a dilTerent list of human traits in form¬ 
ing his judgments, and thereby add six traits to the list on the 
board, 180 human traits would be enumerated on our master 
list. Ti ut this did not happen. No one could expect this to 
happen, However, we doubt if many would think that students 
use so nearly the same criteria in judgment that, of the 180 pos¬ 
sibilities only 10 were actually enumerated by the entire class. 
And under discussion of the class this list of IS traits was re¬ 
duced to G. The 19 traits li.stcd below are given in the same 
order as they were listed on the board by the students, 

1. Quick perception. 

2. Adaptability. 

3. Leadership in .student group. 

4. Ability to reason beyond self-interest. 

5. Mental alertness. 

G. Retention of learning—memory. 

7. General appearance and manner. 

8 . Social poise, 

9. Laughter, 

10. School grades. 

IL Philosophy of life. 

12. Originality in thinking. 

13. Enjoyment of play. 
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In the opinion of the class there was ovcrlnppinff in these 
characterizations. Thci'efore, through considerable lUscnssioTi 
and definitions we were able, ns slated above, to reduce this list 
to six, These six traits which were to form the students’ master 
scale arc given below: 

1. Loatlei'ship among students. 

2. Impersonal reasQuing"—abiUty to reason heynnd one's own 
selfish ends. 

3. Mental alertness—quickness and ensG with which novel 
material is grasped, 

4. Appenrance and manner—ability to present one's self to 
win confidence and respect. 

5. School grades: Grades on nil college courses, 

IS. Originality in thinking: Habit of thinking and doing 
things in an unusual way. 

A careful study of the six remaining traits reveals the fact 
that they, when properly defined, include the 13 former characteri¬ 
zations of the original list: No. 1 is included under No. ,3 of the 
final list; No, 2, under 1 and 3; No. 6, under 5; and Nos. 8, 9, 11, 
and 13 under 1, 3, and 4. The class was in full agreement in 
every instance, except in the case of No. 9—hiuglitor. All agreed 
that “laughter” could be placed under "appearance and nuinner,” 
yet three students insisted that ns a trait for diagnosis of intel¬ 
ligence it is too important to be .subordinated in any way. 

THE STUDENTS' RANKING OF THE SIX TRAITS 
SELECTED. 

At another meeting of this same cUias the students were re¬ 
quested to rank these six human trails on the basis of their 
importance in determining intelligence. Each sLudont was pro¬ 
vided with a printed list of the six traits, and asked to follow 
directions carefully as they were read- “Do exactly what I tell 
you. Select that one of the six human traits listed here which 
you think is of greatest value in judging intelligence in a 
fellow student, Mark this trait ‘highest.’ Now, rclecL Unit i.: ^ 
of these six traits which you think is of least value in judging 
the intelligence of your fellow students. Mark this ‘lowest.' 
With this done, select that ti*ait midway between highest and 
lowest in value and mark it ‘middle.' Select that trait now 
which is of less value than the one marked ‘highest’ but of 
greater value than the one marked ‘middle.’ Mark this trait 
‘high.' Then select a trait which is not so good as middle but 

=l)iuiii{r tliD cla.'is (IlsruH^inn it whs inadv ulnlii J,v Ll»- kIihIciiIm Mini l)y 
Itniiuvsiiniil lOuaunlttR” lUoy iiwnnl Hmj HUiUly lo solvi* u in-oViluin Vo Us 
('jniflu-iloii witliouc tloudliiK ||io Issue liy Ihc InlruaUm uL' tliu ntuHoiml 
olemeiit, ‘ 
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better than lowest. Mark this one ‘low.’ Take the remaining 
trait of the original six and compare its value with that of each 
of the other five. Place it between those two which it is most 
like.” 

When this ranking had been completed by the class and the 
results tabulated, the final six traits were arranged in the 
order of theii’ relative importance in determining the intelligence 
of a fellow student. Their relative positions are: 

1. Mental alertness. 

2. Appearance and manner. 

3. Originality. 

4. Leadership. 

6 . Impersonal reasoning. 

6 . School gi'ades. 

By accepting these six traits as the criteria for judging in¬ 
telligence we were able to use this as a m€'ister scale for rank¬ 
ing college students. 

Some objection may be offered to the acceptance of these 
traits as criteria for measuring intelligence. It may be urged 
against some one, perhaps any one, of these traits that there is 
no relationship between it and intolligenco. Question;-Are theso 
traits earmarks of intelligence? To what extent the^e several 
traits arc characteristic of intelligence it is difficult to say. Yet, 
the following two types of evidence persuaded us to accept them 
as worthy criteria, First, they represent the consensus of opinion 
of an average group of college students as to what they think 
intelligence is, That they had the cori'ect conception of the 
term “intelligence” we are not arguing. Wc do thinl:, however, 
that they had in mind what they call •'intelligence,” and what 
they constantly use in placing their fellow students intellectually, 
and their success in this placement is the aim of this study. The 
second type of evidence is found in the correlation between 
these several traits and the results of the Otis Test. When the 
students were rated on these traits, as is shown further on in 
this study, and compared with their rank in terms of the Otis 
Tests the respective value of these traits fis characteristics of in¬ 
telligence is exhibited. The Otis Tests correlate with "mental 
alertness” .49, with “appearance and manner” .16, wth 

“originality” .48, with "leadership” .24, and with “impersonal 
reasoning” .38, While “appearance and manner” was con¬ 

sidered by the students as the second best characteristic of in¬ 
telligence, this trait does not seem to be important to success in 
the Otis Test, There is a reason foi’ this. And it it this reason 
which causes many people to discountenance intelligence tests 
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and hark back to the practice of the personal interview. And foi- 
the same reason others hold that the intelligence test and the 
personal interview are mutually supplementary. 

CLASS MEMBERS RATED BY MASTER SCALE. 

a. IJy the Studeiils. The class roll in strictly alphabetical 
order was printed on the left side of n large sheet of paper, 
Near the top, the middle, and the bottom of the page was printed 
‘highest,’ ‘middle,’ and ‘lowest,' respectively. Midway between 'high¬ 
est' and 'middle' the word ‘high' was printed, and midway botwoen 
‘lowest’ and ‘middle’ the wrd ‘low’ was printed. One such sheet 
was pi-ovidecl for each of the six traits of the muster .scale, The 
class was directed to i-ate its members in the sumo way that it 
rated the six traits of the master scale on the day before. When 
the class was rated on mental alertness, the papor.s were gather’d 
up. Two days later data were secured in the .same way on ap¬ 
pearance and manner. This two-day interval was allowed that 
we might avoid the chance of habitually assigning a man to a 
certain place on the scale. Only five of the traits wore rated by 
the students, since the college grades were secured from the 
university records. 

By an examination of Table No. 1 several interesting points 
are observed. 1. In the judgment of the class no one sLudent 
possessed all five traits in the highest degree. Student No. 11, 
who makes first place in three traits, is the nearest an exception 
to this. 2. One may rank high in one trait and low in another. 
SLudent No. 8, for example, is given sixth place in mental 
alertness and twenty-sixth in appearance and manner, and No. 3 
ranks second in impersonal reasoning and twenty-seventh in 
appearance and manner. Students 25, 26, and 27 also indicate 
the hmthfulness of this statement. 

This observation is not in line with the “halo" theory as pre¬ 
sented by Thorndike. His findings seemed to indicate that those 
giving the ratings were unable to analyze out those different 
aspects of a person’s nature and rate each independent of the 
others, "All ratings were effected by a marked tendency to 
think of the person in general ns rather good or rather inferior 
and to color the judgments of the qualities by this general 
feeling. A halo of general merit is extended to influence the 
rating for the special ability, or vice versa."" While the data 
here do not indicate the presence of this tendency generally, 
yet in some outstanding cases it seems to have been operative. 

^Tlioriullko, E. L.: A Conslaat L’lroi- in PsifcJiological ilaiiiws, Jonr. Ain’t 
Psj’Chl,, Miu'cli, 11)20. 
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12 
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14 
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correlate with each other the table 
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below. TABLE NO. IL 
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Mental Alertness 


.03 

.40 

.31 

.55 

Appearance and Manner 

.13 


.35 

.54 

,20 

Originality 

.41 

.34 


.(}0 

-53 

Leadership 

.31 

.64 

.00 


,39 

Impersonal Reasoning 

.55 

.20 

.53 

.39 


Average 

.32 

.28 

.47 

.40 

.42 
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With this group of students "appearance and manner” is least 
indicative of mental alertness. In fact, the two traits do not 
appear to hold together. From Table Ho. 2 Ave also note that 
"originality” sliows the highest while "appearance and man¬ 
ner’* shows the lowest intcrcori'clation with the.se specific traits. 
Then ''originality” would therefore, give u.s the must information, 
and “appearance and manner” the least inlormation about this 
whole group of traits- 

b. By the Instructor, Using the same, method a.s the students, 
the instructor rated the members of the class on each trait of the 
scale tlie results are given in Table No. HI. 

TABLE NO. III. 

INS'i’M'CTOlVS KiiTlM.VTKH Of STl!l»KX'l'K. 
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Observations made from Table No. I also apply here. When 
the rating of a student in one table is compared -with that 
student’s rating in the other, this observation is made. Only six 
students are rated the same on nny one trait in both tables. Of 
these, four are on leadership. They are Nos. 11, 14, 17, and 26. 
This agreement, though alight as it seems, selects the highest, 
ranited leader and almost the lowest. 

The intercorrelationa of the traits as presented by the in- 
.siructor's estimates are shown in Table No. IV. 


TABLE NO. IV. 
INTl'JRCOftllBLATIOKS Of TRAITS. 
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Mental Alertness 
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.29 

.85 

.49 

.80 

Appearance and Manner 

.29 


.26 

.48 

.14 

Originality 

.85 

.25 


.70 

.45 

Leadership 

.49 

.48 

.70 


.43 

Impersonal Reasoning 

.80 

.14 

,45 

.43 


Total 

.61 

.29 

.50 

.51 

.46 


"Mental Alertness" shows the highest intercorrclation of all 
the traits with "originality,” the students’ moat significant trait, 
talcing second place. “Appearance and manner” continues to bo 
the lease significant of all the traits. 

CORRELATION OF STUDENTS’ ESTIMATES OF INTELLI¬ 
GENCE WITH STANDARD SCALES. 

In order to test the value of students’ estimates of the intelli¬ 
gence of fellow students by means of those traits, we have 
brought together in Table V the results of Tables I and III and 
the students’ ranking in both college grades and the Otis In¬ 
telligence Teat. 

In column No. 1 the students are ranked by the class on the 
basis of the six traits in Table I. Column No. 2 contains the 
ranking of the same students by the insti’uctor on the basis of 
these same six traits. In column No. 3 the students are ranked 
according to their grades in tlfc ofBce of the University. The 
ranking of the students on the Otis Group Intelligence tests is 
presented in column No. 4. Their scores were made on the 
"Advanced Examination: Form A. Edition 1921." 

The instructor’s estimate and college grades are combined 
for the ranking given in column No. 6. This is done to get a 
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comparison of tins combined rnking with the results on the Otia 
Test, Before ntfcempting to compare the estimate made by the 
students to any of these standards, I think it wise first to de¬ 
termine the value of the instructor's estimate, tlie college grades, 
and the Otis Intelligence tests in relation to each other. Since 
the Otis test is generally accepted os a stnndnrd measure of in¬ 
telligence, I will cvtihiatc the others in terms of it. By compai'- 
ing column 2 with column 4, one secures n correlation of ,46, 
between the instructor's estimate and the Otis Teat. In the 
same way the relation between college grades and the results on 
the Otis test is found by comparing columns 3 and 4. This 
correlation is .63, By a compiirison of the rsinkings in colLimn,s 
2 and 3 the correlation betwcGii instructor’s estimate and college 
grades ia found Lo be .41, The instructor's estimate and college 
grades arc often combined in Judging intelligence. Their com¬ 
bined value when compared with the Otis test ia found by com¬ 
paring coliimna 4 and 5. The correlation is .57. When combined 
in this way they give a higher correlation with the Otis tost 
than cither one when taken alone, These correlations are 
“markedly present," yet not too high. However, since both in¬ 
structor’s estimate and college grades are in such common use 
I nin using them ns standards along with the Otis Intelligence 
Test. 

These three standards are significant because of the fact that 
they are of different types. The Otis Test is ii theoretical attempt 
to build a scale of measurement. Its further value lies in the 
fact that its scores check favovobly with seoves made on other testa 
which are equally sound in theory. The instructor's estimate ia 
an entirely different kind of standard, tt is an individual judg¬ 
ment, while the students' estimates form a composite judgment. 
Theoretically this last should be the proper basis for judging, for 
after all this is the (Inal criterion in the busineaa world. It is the 
composite judgment of one's fellows that places one at a particu¬ 
lar level, Hollingwortb finds that group judgment is more ac¬ 
curate than the judgment of the individual. "The individual 
judges intelligence with a correctness of only .19 on the average; 
the group judges intelligence with an average correctness of .61.” ' 
fl. Instructor's estimate. By a comparison of columns 1 and 2 
of Table V one is able to determine the relationship between the 
students' estimate of intelligence’and that of the instructor. This 
relation, expressed by means of correlation is .01. This is a 
rather high correlation and would seem to justify the conclusion 
that the summation of the opinion of students with the maturity 
and college rank of this class is as good a measure of intelligence 
as their instructor-’B judgment. 
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TABLE NO. V. 

ESri.Mil'i’KS AKD KTAXDAKD .SCALAR, 

Inst. 

Estimate 
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Studont.'j’ 
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Otis College 
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Estimates 
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28 

24 
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15 

14 
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3 
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11 

8 
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10 

28 

9 

4 17 
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9 

7 

27 5 
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7 

16 
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8 

30 
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24 30 

8 

12 

1 

8 

1 1 

9 

11 

22 

25 
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15 
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12 
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4 
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16 3 
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13 

10 
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10 

16 

26 
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30 29 

1 G 

4 

2 
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1.3 
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21 
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10 
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25 

14 

12 

6 
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26 

17 

19 

2 
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27 

0 

8 

11 

5 8 

28 

2 

15 

12 

25 12 

29 

18 

29 

14 

9 24 

30 

24 

13 

23 
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b. College grades. When the rating of the inembers of the class 
made by the students and found in column 1 is compai'ed with the 
results based on college grades and in column 3, the correla¬ 

tion i.s found to be '.34, This is in keeping with the student judg¬ 
ment, for wlien building their scale they placed college grades as 
the poorest of the six traits for measuring intelligence. One 
must not confuse the student’s ability to make college grades with 
what he actually docs. These students are ranked on the grades 

Ul(>rflnl;Hwi)rlU; Slxtmva Vltaractef piigu 'il. .‘Sitiill.ir (Itiillnifs aix- 

rpporliel )n tUlicr cliniiters of MiIji hf>ok. 
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tliey have nctually ninrle. Wc cannot sny liow nearly Lhey ap- 
in-oacli tlio best of their several nbilitica. 

c. Oi/a InleU>{/<^>tcc Tests. As n final measure of the sLiulents' 
GstimaLes of inLellipencc the students are rnnUed accortliuK: to 
their succeaa in the Otis IntcIIiKcncc Tests. Tlio vniifre nf tlioir 
scores on this test was from 126 to 203. The correlation o£ tlie 
two ruakiugs thus given in columns 1 and 4 in Talilo V is .61. 
Students estimato.s of intelligence coininti-e very fuvcn'Libly with 
the vosulLs of the Otis Test, .slightly better, in fact, than other in- 
vesLigntors have found college gradc.s to relate to intelligence, 
Pressey obtained a correlation of .‘18 between intelligence’ and 
school marks.' Terman found a correlution of .45 between .school 
innYkc and inoiital age." Book I'Ciiovts the coefficient of covveltilicm 
for his'h school seniors between .school mark.s and intelligence to h? 
.47.’ If, therefore, we take the Otis Intelligence To«t as a ntan- 
davd the consensus of student opinioii must be hi.ghly rpr.i>{'cted 
as a ineasurs of intelligence. 

SUMMARY. 


1 . Cov veie tiott Summary ; 
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.34 

.61 

,48 

lusLriictor’s Estimates 

.01 


.41 

.46 

.82 

College Grades 

.34 

.41 


.63 

,83 

Otis Testa 

.61 

.46 

.63 

. 

.67 

Col, Gracles and Inst. Est. 

.48 

.82 

.83 

.67 

. 

Average 

.49 

.60 

.62 

.62 

.07 

2. If the instructor's estimate 

is nn 

accepted 

standiii'd. 


consensus of student opinion, gained under the conditions of our 
experiment, is a better’ measiiirc of intelligence than college grack'-s 
or the Otia Tests. 

3. If the college grades are taken aa the accepLcd shandard the 
students' estimates arc not so good a measure of intuliigonce as 
cither the instructors’ estimates or the Otis Tests. 

4, Accepting the Otis Te.^ts as a standard, the studeiiLs' esLi- 
inates are practically as good a measure as either the insLrusLors' 
estimates or the college grades. If, however, the instructor.s' es¬ 
timates and college grades arc combined, they give a slightly 
better measure. 

ij, b, 1 Thp KfflclPniy of the (froup rutiU Nralr. in f'rot/iititlle ii limi 
Sii(( <«i roKi lu .liinlor J/lyh iS'riiun/. Jour, of Aiiplli'tl nsycliuU)(,'}% 

•3 I'iSl'dS*). 

' Toi'iniiii, Ij. M. : The fiHetUacncc of RcJiool CliiMrviij lOlIl, piiun 71), 

’nook, U’. I’.: 77ic luiellloriivc of High School ScntoiSj 11)2:2, piigr’ 10.'. 






A SCHEME FOR COMBINING INCOMPLETE 
RANKINGS 

Bv 13. r. Haugiit 

The Stntc University of New Mexico 

School marks are usually nssiKiicd to several groups of studente 
in terms of letters. The number of groups ranges from three to 
seven. When these marks are to be eomhined in such n way to get 
the student'a average standing, the task is found perplexing and 
often ninbiguous. Sometime.'? porcentngo values are assigned to 
each letter and these values averaged. In other cases point val~ 
use as 5, 4, 3, 2, 1 and 0 are assigned to the letters A, B, C, D, E, 
and F respecLivoly and the average found. Both of tlioso methods 
often give very unsatisfactory results. The principal cause for 
this is the variation in the absolute marks assigned by difTerent 
instructors. In .some el.a.=ses where there is no reason to infer 
that the selection has been great, a targe per cent of the class 
receives high grades and at the same time in other classes the 
low grade.'; are more numerous. In order Hint the work for the 
semester or term may be averaged in a satisfactory manner, it is 
desirable to find some scheme tlmt will partially eliminate ihis 
wide variation in teachers’ judgiueats. 

Teachers agree much more closely in ranking a groxip of stu¬ 
dents or a buneli of examination papers than they do in assigning' 
absolute grades in tonus of letters or percentages. Usually there 
is no difficulty in ranking the best and the poorest fourth of the 
class, It is not usually difficult to rank a class of thirty with coii- 
sidevablc accuracy. The smaller the class the easier the task 
unlcs.s the i)roces.g of selection has been very great. Even then, 
if vig'oi'ous work is required and the tests are made difficult 
enough, individual differences are revealed. 

That ?n.striictors do vary greatly in their marks does not need 
further proof to those who have had experience with teachers’ 
grades. That rankings made by different teachers are less vari¬ 
able and consequently much more reliable may not he accepted so 
readily. Meyer published the distribution of marks assigned by 
forty professors at the Univci’.'sity of Missouri to their students 
in a period of five years. These distributions show that the per 
cent of A’s assigned ranges from 1 to 55. Similar tabulations 
have been published for Harvard University, University of Wis¬ 
consin, and Cornell University All these tabulations furnish 
evidence of the wide variation in marking. Starch presents fui*- 

‘Stiu'cli, Duulol; /’syf/iolnyy; 
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ther evidence to sliow tlitiL the variation amonj? leaclievs in ntuvk- 
ing the snnie paiier is just as great. When school worlc in two 
subjects like arithmetic and languiiKe, howevoi-j is correlated, a 
mni'lced or high correlation is ii.sually ol)tainc<l \ Thi.s is evidence 
that, although the tcnchcvs have varied greatly in the siiccific 
inavlcs assigned, they have not varied .so much in tlie order of 
ranltiiig. 

If we admit that rank.s are more accurate liuin the traditional 
school marks, are we any nearer the .solution (jf our problem? 
How are we to combine these ranks? No instructor will rank all 
the stiuloiits in any one cla.ss. How .shall we weiglU a rank of 1 
in a class of 5 and the same rank in a clus.s of Ho? Certainly 
they shoukl wot have equal weight. 

The ih’st investigation that attempted to solve this problem, us 
far as the writer know.s, wa.s by Profe.'isor E. L, Thorndike 
Recently other investigations have appeared. Important among 
these is the one by M. J. Roam Ream’s metliiul is only a modi¬ 
fication of the one set forth oarlicr by Thornililcc, hut certainly 
is better in being more accurate and les.s laborious. The .scheme 
here presented is only a modification of that stJggoi.Led by Ream, 
It is better £ov two reasons. First, it eliminates negative signs 
and decimal fractions, both of which are likely to cau.se error.s, to 
say nothing of the extra time and care. Sect)nd, tlie nnil.s are 
expressed in porcentne.s instead of in standard deviations. Tlio for¬ 
mer hns more meaning to the average person. It is, of course, 
true that they amount to the same thing. 

It is assvimed that all distvibiilion.s arc normal and that any 
skewness is due to the teacher's inaeeuracy iti grading or inark- 
ing. This assumpLiou is i\ot absolutely iruo, hut it in much U'uov 
than to assume the distrihulioiLs obtained from tlic teacliers’ 
grades correct, In the writerks opinion, to throw a distribution 
into percentiles and thu.s give it the form of the normal frequency 
curve corrects many errors of judgment on the part of the 
teacher. It will have to be iidmiUed, however, that it introduces 
.some errors as well as retains some of those alroady Lhot'c, Tlii.s 
is especially true when the group being comsidered is liighly 
selected. 

A concrete example of how the percentiles are found for a 
class of six will make the procedure clear. Fir.sL, the nunibcrs 1, 
2, and S are divided by 6, the number in the chie.'^. Tbi.s give.s 17, 

^SliiiL'li, Daiiii‘l: l!iliifalUi$uil I'njivhulniiy: lUca. 3l-."»7 

^'I'liDi'eiillUc'i E. I,.: Vhr. 7Vc/im///■««• uf Cuinliiniiio liivniinih'tr .lii'hniinih "I 
Uic t./j ii iitiifi \,fi a Jti-hiiK ,»uurn;il i.l' I’liniiscii'tiy, 

rs.vcIidluK'.v iiiul Kricuilllr- ]ili-llii>il‘4, ima, i:5, 1H7-J0I. 

M. J.: .1 .yhitlstli-iil .\h llitiil fur Iiiroiuiilrlt' <httrr uj Mnil Uul- 

iUlfst. Tim .Jriui'imt i»C Aijii1Ii-iI l'sj-«-li4ili)(jy, lOlIl, .1, 
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33 and 50. Second, from Thoriidilse's Mental and Social Measure¬ 
ments, Table 54, the numbera cori'eaponding to 17, 33 and 50 are 
1,49, .68 and .22 respectively. Third, 3 is added to each of these 
numbers to give the distance in terms of the standard deviation 
from the lower end of the disti’ibution instead of from the middle. 
Fourth, ench of the three suin.s i.s divided by 5, the length of the 
distribution in terms of the standard deviation. The quotients, 
7fi, 01 and G4 are the percentiles. The scores fox- the lower half 
of the group jnny be found by inspection since the distribution is 
assumed to be symmetrical. 

Metliod of application. Now suppose we wish to find the aver¬ 
age scoro of an individual. Let us take an actual case, that of 
student X. I-Tq ranks 

1 in n class of 6 

1 in a class of 42 

2 in a class of 18 

2 in a class of 22 

13 in a class of 40 

By con.suUinfi’ the tabio.s, wc find the corresponding percentiles tO' 
be 75, 91, 73, 76, and 58 respectively. The average of these is 
74,4. In a lilw manner the averag-e may be found for all other 
sLudent.s. 

At the University of Now Mexico, each instructor is requested 
to ranlc the upixor half of his clnsso.s and include these rankings 
in his final aomcaLor report. For the semester ending January 28, 
1922, the writer asked each instructor to rank the lower ns wen 
as the upper half of the class. Two exceptions were made. The 
instructor of history was not able to havg charge of his classes the 
last month. They were taught by .substitutes and for this reason 
are not included. The other exception was music, which probably 
depejids more upon special ability than upon general intelligence. 

After all the data were assembled, the average for each student 
was found in a manner similar to that used in the illustration 
above. All subjects that were not ranked as many as three times 
were discarded. No attempt was made to separate the college 
classes. If freshmen and seniors happened to be in the same 
class, they were ranked without respect to cla.ssification. No dis¬ 
tinction was made for classes meeting two, three, four, or five 
times a week. This could have been done, but seems foreign to 
the problem. 
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Duriiig the semester the writer gave the Alpha tests to 1J8 
students in the University. A Cew of these dropped out before the 
end of the semester. AUogcther there were 138 who had scores in 
scholastic achievement and in the Alpha tests. The 138 .sLiulent.H 
were assigned percentile rank.s in each trait. Those were assigned 
in such a way as to make the distribution take the form of the 
noriual probability curve. 

As a cliGck on this method of finding .scholastic scores, the fol¬ 
lowing values were assigned to the several loLLevs and the stn- 
denb's average grade found: 

A=94% D=74% 

B=88% E=fi7?i 

C=81% F=50% 

After these averages were found, the 138 sUidonts were assigned 
percentiles so as to give the di.stribntion the form of the normal 
probability curve, Three correlations (by the product-moment 
method) were now obtained; first, between intelligciico.lest.s and 
the scholastic standing determined w(iolly from the ranks; second, 
between the intelligence tests and the .scholastic standing deter¬ 
mined by assiging absolute values to the letters indicating the 
grades; and third, between the scholastic standings determined by 
the two methods indicated above. The tlii’eu. correlations are ve- 
pectively, as follows; 

r 

1 = .10 
r 

• r 

3 = .7.S 

The method of disregarding absolute grades and using only the 
ranks, then, gives a more reliable result judged from the intelli¬ 
gence tests as a criterion- The dilfcrcuce between tho two methods 
is small, yet it is sufheient to be significant when this mimbe)' of 
subjects is u.sed. The two scholastic rankings have a higli corre¬ 
lation, yet it is far from perfect. 

Great scientific accuracy is not claimed for the scheme here 
set forth. It is as accurate as any now in use and hag the nd- 
vantage of being very simple and easy to manipulate, The 
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smaller the class the less iclitible avo the results. In classes as 
small as four ov five no great injustice seems to be done to any 
one unless all the members are very good or very poor, which is 
not likely to happen. 
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Showing percentile scores as determined by the number in the class and the rank in. that class. 
Numbers at the top of each column indicate the number in the class and numbers in the column at 
the left indicate the ranks. 






THE BASIS OP TOOTH PASTE SALES IN REPRE¬ 
SENTATIVE COMMUNITIES 

By Donald A. Laird. 

I. INTRODUCTION 

This is a report of a fairly extensive survey which wns mudo 
of two distinct coinmunitiea with reference to the use and the 
sales of tooth pastes and similar preparations. The .survey was 
made by a class in the psychology of ndvertisinB ns a term pro¬ 
ject. It was conducted in Laramie, Wyoming, a town of about 
seven thousand inhabitants. The population is composed in the 
main of retired rnnehevs, business and professional families, and 
the families of workers in the refinery, plaster mills, Union Pa¬ 
cific division employees, and a scattering of students. 

It was not attempted to cover the entire town. Rather- the aim 
was to select aa rigorously aa possible; certain sections which 
represented unequivocally sociological extremes typical of the 
Main Street town. One section of the town wns chosen for study 
because it represented the elite, contained the residences of the 
better' classes, business and professional men, university families, 
and a scattering of well to do ranchera who manage their land af¬ 
fairs from the town. This section was purposely kept smnll in 
order to bo certain that the families who contributed information 
for this group were without doubt properly labelled. In a small 
town there is little difficulty in so classifying the townspeople. 

Opposed to this section, the creme de la crevia of Laramie, a 
section was mapped out which contained the colored section of 
the population, a majority of the foreign element, and the un¬ 
skilled workers in general. This section is commonly referred to¬ 
ns the West Side. In this report the two groups will he designat¬ 
ed the Elite and the West Side. 

II. THE SURVEY. 

A house to house canvas was made of the two carefully selected 
districts, Tor each house information was gathered under the 
following beads: 

1. Street and number 

2. Persons in family (excluding roomers) 

3. Brand of paste used 

4. “Why used (flavor, dentist's advice, samples, advertising, 
friends,'etc.) 

5. How many tubes usud 'a month 

6. How many in family use paste once daily 
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7. Any obhor brands ixsed in family 

8. Why others nve used 

The canvasers were instructed to pass by any homes which seemed 
by outward appearances not to properly belong in the district 
being surveyed, 

The sfciideiits were divided into two equal groups, one Xor each 
section. A student was selected from out of each group to serve 
as section captain in taking charge of the details of the survey. ' 
Several students not in the class requested an opportunity to take 
part in the data gathering. The only canvascr to be thrown out 
of a house was one of these volunteer solicitors who was ejected 
bodily, even though the doOr-mat read “’Weleome!” 

III. RESULTS.= 

A total of 228 families were interviewed, 104 of which were 
from the Elite distx’ict. This repoi't is based, however, upon only 
148 families. Some were eliminated due to grossly incomplete 
data, some others were also eliminated from the Elite returns 
because of bad ratings in the local credit bureau. Eighty-one of 
the faniilio.s to bo reported were from the West Side, 

Table I gives the disti'ibution of the families arranged by num¬ 
ber in the family. 

TABLE I. 

jiisriuuvriox or nixk or famija’’ ix thk two i>i.stui(;t,s 



Frequency 

Number in family 

Elite 

West Side 

1 

0 

1 

2 

18 

19 

3 

18 

16 

4 

12 

14 

6 

14 

14 

6 

1 

9 

7 

2 

3 

8 

1 

3 

9 

1 

0 

10 

0 

1 

11 

0 

1 


The medium size with the Elite gToup falls in the 3 interval, 
with the other group the medium falls in the 4 interval. The 
ai'ithmotical mean for the Elite family size is 3.6, on the West 
Side it is 4,1. 

In 67 families in the Elite section there are 64 that make use 

'fici'tlnii caiitains wauv Mr. Roitert .fuIinKon ninl llnitT riit'Rtioiii. 

^TaUuInloil wllh tin* aHslsliiiiCL* ot Mr. Rnlpli Iloltsmn lunl Mr. WUliuil 
lU'okiiw, 
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of a toothpaste, at least one member of the family uses it, In the 
other section there are 53 families out of the 81 in which at least 
one member uses tooth paste. On a per cent basis this is 80.6 per 
cent of the Elite families and C5.4 of the West Side families in 
which tooth paste ia used. 

It was difficult for many of those interviewed to conscientiously 
state, in reply to item B, how many tubes wore used a month in 
the family. In the Elite section there were only 20 families in 
which this reply was recorded. In the other district 45 families 
replied. These families represent 77 individuals in the Elite dis¬ 
trict and 194 individuals from the West Side. The twenty fam¬ 
ilies from the Elite group report the use of 37 tubes (full size) 
a month. This is an average consumption of 0.48 tube a month 
per individual. It must he borne in mind that this is per individ¬ 
ual for whom we have data available. If this included all the 
families it is quite probable that there would be a zero after the 
decimal point. The West Side families i‘eported the consumption 
of 84 1-3 tubes per month. On an individual basis this is 0.43 
tube per individual per month among those who reported. 

These results are somewhat in contrast. Among all the famil¬ 
ies interviewed we have found that a considerably larger per 
cent from the Elite district use a dentrifice., But when this com¬ 
parison Is reduced to a comparison of amount used by those that 
do use a dentrifice then the two groups practically coincide. 

Of most interest from the point of view of advertising ia why 
the users use the particular brand that they do, Admittedly in 
many instances the replies to item’ 4 were rather forced, for they 
had never given the matter much consideration. Ratio7ializationa 
in forced explanations were undoubtedly very conspicuous. But 
at that the reasons atU'ibuted by the users for their use are a 
revelation. Especially when checked up with the chief overt ad¬ 
vertising appeals that ate in vogue in the marketing of these 
prep arations. 

Table II gives a detailed tabulation of the responses to item 4. 
It should perhaps be noted in passing that before the solicitors 
went out into the field they were gathered together and instructed 
regarding the data to be collected. They were especially warned 
against suggesting any response other than what might be the 
natural one. In the case of item 4 the suggestions in parentheses 
were arrived at after the group making the survey had tabulated 
their own reasons for using their particular brand of dentrifice. 
In case it was necessary to give suggestions to the person being 
being interviewed they were instructed to read the entire list of 
suggestions before letting the subject respond. 
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TABLE II. 

nrjAsoNfi GIV13N Xi'an tub use op dentripice, bi' rran'd and 

SBCriON 

Elite Section West. Sactioii 


'V 

53 .2 

^ I 

Colgates 19 

Pepsodent IG 

Pebeco q 

Kolynos 3 

Cham¬ 
berlain’s 1 

Cblorax 1 

Dr. Grave's 1 

Listevine 1 

Soda or salt 3 

Dv, Lyon's 0 

Nyal 0 




K £ a a 
o •,-r i e 

_rr V C* - ft i 


■3 i.-- '3'-* ^ 

(4 -ri U 
1110 


ft s *r 


28 



Wi [rf «; 

9 12 3 0 0 2 2 


G 7 0 1 0 


2 0 13 7 


3 2 0 0 1 0 


0 0 0 T 0 

0 10 0 0 

0 0 0 0 0 

0 0 0 0 0 

0 0 '0 0 0 

0 0 0 0 0 

0 0 0 0 0 

0 0 0 0 0 

0 0 0 0 0 


0 T 0 S T 

2 0 4 1 0 

0 110 1 

1 0 0 0 0 

1 0 0 0 0 

10 10 1 

3 0 110 

0 0 2 1 0 

0 0 2 2 0 


S 0 P 0 G 

1110 0 

0 0 0 0 0 

0 0 0 0 0 

0 0 0 0 0 

0 0 0 0 O' 

0 0 0 0 0 

0 0 0 0 1 

0 0 0 0 0 


Totals 13 20 1 4 2 13 1 21 17 7 1 1 3 3 

A corapai’ison of the totals columns shows the difference between 
the two communities in the matter of paste used. The pveponder- 
ence of Pepsodent and Pebeco in the Elite section is worth men¬ 
tioning in passing. There are other interesting but minor differ¬ 
ences in the choice of a dentrifice between the two groups, 

When the reasons given for the use of the particular brand arc 
examined grouio differences also appear. The largest difference 
under this head is in the advice of the denti.sts. This appeared 
13 times in the Elite section, and 1 time in the other section. 
Samples, which had been given the children in school, was given 
as the reason for the start of the use of a particular brand in' 
three homes of tlie West Side, and not once in the other section. 
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The in-eclomiuant reason for the use of personal brands was 
that of tlie flavor of the preparation. NoKlecLing tho no reason 
responses this reason o£ the flavor buinp* liked luia a. greater fre¬ 
quency than nil of tho others combined. The ratio of 47i29 
between the use of Colgatca and PepsodenL ean largely be ex¬ 
plained on the basis of flavor. Even in the Elite .section where 
one would expect to find tho consumers inlluonceO by Rcionlific ap- 
pcala in aclvertisiiiff we still find flavor predominnLitig over dentiil 
advice and advertising hr the reasons given from this group. 

Undoubtedly the manufacturers «ro well aware of the impor¬ 
tance of flavor in a dentrifice. Their adverti.sing, however, almost 
without exception is directed toward certain scientific soiuidiiig 
appeals for the use of their product. When ore gets down to the 
reasons given for the use of any particular bvtuid, the acicutific 
reason is not mentioned a single time. Undoubtedly it is the ad¬ 
vertising, based upon the opinions of high dental authorities, that 
has established the rigorous tooth paste habit of Mr. Averago Citi- 
aon, -whether he lives oit the West Side or on Easy Street. Flavor 
on the other hand, seems to bo the principle determining reason 
for the use of any particular brand. 

IV. SUMMARY. 

A house to house survey was made of the two distinct districts 
by the students in a doss in the psychology of advertising. A 
good and poor residential district was covered. The tooth paste 
habits of the inhabitants was OTwiuircd iirto. It was found; 

1. This is an excellent method of instilling tlic spirit of scien¬ 
tific psychological approach to the problems of advertising; 

2. About 80 per cent of the families from the better section 
and 66 per cent from the poorer section make some regular use 
of a dentrifice; 

S. On the basis of individual consumption, there is no signifi- 
caut difference between the sections among those l/int do use a 
dentrifice. In other words, when the tooth paste habit once hits, 
it hits with equal force in both districts; 

4. But, the tooth paste habit does not occur with as great fre¬ 
quency in the poorer* district as in the better class district; 

5. Dentist’s advice plays but a very minor role in the use of 
denti’ifices in the poorer districts; 

G. In both disti'icts the predominating reason for the use of 
any 'particular brand ig determined largely by the flavor; 

7. School samples play no apparent part in the use of a 
paste in the better districts, they do play some part in the poorer 
district. 



VOCATIONAL TKSTvS FOR AGRICULTURAL 
ENGINEERS 

By II. K. Burn' and F. W, Ives 
Oliici SLaLe University 

INTliODUCTION 

Tlie follon’inf? i.s n cruitriljiiLion to Llio clcvolopniont of voctition- 
bI norms wiiieh art: c.ssaiiLial for scientific vocational ft'niclfincc and 
scloction. It presents niiLliinfi’ pnrLicnlarly novel in the way of 
tDchnicpie blit ffive.'^ ibiLa for a vocation that has not hitherto been 
studied in this- imiiiiiei'. 

It is obviouH in Llic university as well as aubaoquently that some 
mon who uiulei'taUe a}.i;ricult\iral enjfineGrinj? as a vocation lack 
the retjuisite nlnlity. Hence the problem of vocational prediction 
is in point. liloreover this vocation requivos more than mere in¬ 
telligence. Observation and analysis makes it dear that it is to 
quite an extent a question of .special ability. So an effort wa.s 
made to devise .special rnciitnl le.sLs for predicting this ability and 
to .sUndardize them on advanced students in agricultural engin¬ 
eering, 

METHOD 

Tlie selection of the tests was based on some preliminary experi- 
inont.s the ])revjous year a.s well as upon further analysis of the 
mental fuctorR involved in the vocation. Typical of such factors 
are motor coorclinaLion involved in the use of surveying and draw¬ 
ing imstrumonts, various aspects of attention involved in testing 
farm macliinery and taking readings at the proper moment, spa¬ 
tial perception and imagination involved in planning farm build¬ 
ings with reference to their contentsj and observation and judg¬ 
ment involved in planning topograpliical layout or drains. While 
no mental test measures any sucli factors exclusively, an effort to 
approach such measurement is £nr better than random selection 
of test material. Some of the testa employed were modifications 
of those u.scd by various investigators and some were deidsed 
especially for the occasion. Those which proved useful and were 
retained in the final norms will be described below. 

The tests \VGi*e given, with two exceptions, by means of mimeo¬ 
graphed blanks. All the blanks were clipped together in a folder. 
The group method was used and each test had a time limit such 
that no subject would quite finish it. Each test comprised two in¬ 
stallments,—on successive pages or on the same page separated 
by a space and the word "stop," according to the amount of ma- 
torinl. At one sitting the first installments of all the tests were 
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given in succession. Tlie followiiif^- clay Llie .second iii.stallnioiits 
-\vere given in the same onlev. It wa.s thus possible to locate cases 
AVlieve the subject misuiulerstoocl or nuulo a bad staet and al.so (if 
desirable) to correct for attonnation. The order of the tests was 
designed to avoid undue fatigue by inter.spersing tests rotiuiring 
close concentration and elTort with tho.se .somewhat loss exacting, 
There were 14 te.sts used but as several were scared in more than 
one manner, there were 18 dift'orent indci^ciulent variable.s involved 
in the research. 

The directions were givon orally, Tlic first page of the folder 
contained example,? of various tesL.s and after finishing one test 
the subject marked the place in the folder with the finger and 
turned back to the example page during the explanation of the 
next. The example.? wore in ino.st ca.se.s do.signcd to allow one or 
two itein.s for practice. The diroctions were, of course, standard 
and given verbatim but were al^hreviatod somewhat for the second 
installments. 

The subjects were 4." advanced students .speciaU/ing in ap;ricul- 
tural engineering at Oliio State Univer.sity. Tlicy were tested in 
two groups during the winter of lf)21-22, They were directed to 
take the examination by the dean of their colleg'e so it i.s safe to 
assume that incentive was sutlieiently near u maximum to be con¬ 
stant. The testing wa.s done personally by one of the writers 
(Burtt), The total time for the test.s, including directions w’as a 
trifle over two hours, i. e. one hour at each .sittin,";. 

The ci'itevion for evnkuiting the tests consisted of ratings as to 
"ability in agricultural engineering" made by three in.stviictor.s in 
the department. Ratings were u.sed rather than grade.? in engin¬ 
eering studies on the theory that the latter arc less apt to reflect 
a man's actual ability, 

The ratings were made on a linear scale of the sort commonly 
used. The names were,typed in a column at the left of the page 
followed by five ruled columns of uniform width. Tliese columns 
were headed from left to right "lowest fifth”, "next ]o\vc.st fifth” 
etc., and represented the distribution, on the basis of ability, of 
all the persons pursuing this vocation whom the judge new. A 
cross was to be placed after each name indicating the .student’s 
ability with reference to this whole dhstribution and the gTeater the 
ability the farther to the right the cross was to be placed. A pre¬ 
liminary statement at the top of the blank explaincti this method in 
detail. The ratings were then measured in ]nilliinefcer.s from the 
left edge of the left column, tlius expi’cssing the, judgment 
quantitatively. 

The instructors made their ratings independently. The raw 
figures could not bo validly averaged for a given subject because 
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i:hc judges might difT’er in tbu centi'al tendency nnd scaltev o£ tlieii' 
ratings, ConsGcjuinstly each judge’s estimates were converted into 
Llio lorm x dividcw3 by ftii/nut, i. o. the deviation ol the mcfiauro in 
question from the mean of thnt j'udgc'a I'atings taken in terms of 
the .standard deviation of his ratings. WitJi such converted jnens- 
urcs the three judges' esLiiuiites for a given .siilijecL could then bo 
averaged to gut a coiuhined rating (the critei-icm). Most of the 
sabjocU were rnted by Ml llireo judges but in the c.osc of three- 
subjects only one rating was available. 

The next step was the final selection of the tests. The scores 
for the two insLallments of each test wore added together to form 
a singio score which was used throughout. Correlation scatter 
p]ot.s were then nnuJe for each to.st against tlie criterion. It was 
found convonienL to plot several pairs of variables siniuILanoousIy, 
keeping the criterion on the ordinate, aligning the bhinlcs, placing 
a long ruler below the desired row nnd checking in the proper 
column on each blank for the other variable.?. Those j)lots whicli 
showed by inspection any .semblancG of correlation were coinputed 
by the “prodLicts-momonts" formula. Eight of those were retained 
as showing .some promise (the highest coefficient beijig .47) and 
intercovrcbiLcid and the regression equation derived, 

DESCRIPTION OP TESTS 

Only the seven tests which appcai*ed in the final rcgresaion 
equation will be described. There were eight te,sls in the equa¬ 
tion but the weighing of one of these proved to be zero. They 
are numbered us they wei’e in Lha equation hut these numbers 
have no ulterior significance. 

Tost 2 cousisted of a series of small circles (letter "o” on a 
typewriter) in two columns 2j>< inches apart. Those in each col¬ 
umn were double spaced on the typewriter with the right column 
a single space below the left. They were numbered alternately 
in the two column.?, i- c. odd numbers in the left and even num¬ 
bers in the right. The subject connected the circles in the num¬ 
bered 02 -dor, i. e. drew straight lines from side to side, gradually 
moving down the page. He kept time with a metronome set at 
120, i. e. made a stroke to the light and back again in a second. 
There were B6 circles in the column. The subjects were stopped 
immediately at the moment they should have finished so that if 
they did not keep with the meti'onome their blank was incomplete. 
There were two series of this sort on a blank. One was done as 
above described but for the second the page was turned 90 
degrees so that the strokes were up and down. One such page 
constituted an installment of the test. The instructions were to 
stop as near as possible to the center of each circle but to keep 



181 


nURl’T-IVES 


time with the metronome. For acoriiiff, a transpuvoat stencil 
was made with a ^4 inch circle concentric with each "o", A.II 
strokes the end of which fell within this circle counted one point, 
This penalized those who did not follow the metronome to the 
extent of one point for each stroke they failed to make. The max¬ 
imum scoi'e was 224, 

Test 3 had at the top of the page a Ini'i^e diagram of a triangle, 
circle and rectangle overlapping in such a manner that there were 
areas eoinpri.sing all three figures, each combinnlion of two of 
them and each alone. In each of these areas wore several symbols, 
—vowels, consonants and digits. The following are typical of items 
which appeared below the diagram; 

1, Vowel that is in tidnngle but not in circle or rectangle ( ) 

2, Smallest number In ch’clc and rectangle but not in triangle ( ) 

3, Consonant that is in rectangle circle and triangle ( ) 

There were 14 such items in each installment. The instructions 
were to place in the brackets at the end of ench line the letter or 
mnnhev called for by the spcclhcalions in that line. The tinro limit 
was 2 minutes for each installment. The score was the number of 
items correct with a Tnaximnm score of 28 lor the total test. 

Test 4 wa.s Thurstone’s “Special Relations given in one in¬ 
stallment only with a 4 minute time limit. The subject was given 
ample time to rend the printed directions attached before turning 
to the test. The score xvas the number of items correct mimus 
the number wrong, The maximum score was ?/J. 

Test 5 comprised lines of digits in apparently random order,— 
05 digits to the line.' The test consisted in crossing out 2 and 
ringing 3 until coming to a 7 and then revev.sing the process,— 
crossing 3 niul ringing 2,—until the next 7 etc. It was ar¬ 
ranged, however, so that the first reaction after a 7 was alwaya 
a “cross out,” The subject knew this so if he hecaine "lo.sl” it was 
necessary to go back merely to the last 7. There were five crucial 
numbers between each pair of 7’s and three such units per line. 
One unit comprised three 2’s and two S’s and the next unit two 
2's and three ‘i's etc. There were six lines in an installment and 
the time limit was 1 minute and 4B aecond.s. The subject was 
given one point for each correct mark. Furthermore in case sev¬ 
eral items in a unit were marked the opposite of what they should 
be and the subject had manifestly started the unit wrongly and 
veuctecl thereafter accordingly, he was given credit for the sym¬ 
bols thus marked but penalized one point for the initial mistake. 
The maximum total scoi*e was 180. 

'A U'h( wlmUiw In this Inis hppn wsort \)V U. A. 'i'oops. Pxil. ns fur us the 
ivrlU'rs ui'o airnru Jms nol been inibllalicd. 
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Test 6 was auditory memory by the method of word pairs with 
logical material. Thei'c were three types of word pairs used: one 
type was uornial, another comprised words related to agricultural 
engineering and a third involved pairs dealing with zeal, industry, 
interest in one's work etc. These three types rotated in succes¬ 
sion through the list. The following is typical of a sequence of 
such pairs: 


1 

letter 

stamp 

2 

formula 

equation 

3 

task 

eager 

4 

diamond 

spade 

5 

liquid 

liydi'oinoter 

6 

strive 

attain 

7 

.spider 

spin 

8 

engine 

windmill 

9 

work 

plc:t.siire 


There were 27 pnir.s i?i a series,—9 of each type. Two sucli series 
constituted an installmenl. The instructions were to listen while 
the 27 pairs wove read and try to notice the natural connection 
beLween the two words. A meti'oiioine, soinewhal muffled, sound¬ 
ed one beat a second as a guide for the experimenter. The two 
words read on two successive boats and there was a pause during 
the third boat. Thu first word of the next pair came on the 
fourth beat. The subject’s blank consisted of a series of nuni- 
hei-od lines. Jj?7medintely aflei* the initial reedij?g o£ the list hy 
the experimenter, the first words of each pair were read with the 
appropriate number, e. g. 'T letter, 2 formula" etc. The subject 
wrote after the appropidaLc number the word tljat had paired 
with the one in quo.stion. Five seconds "WDre allowed for each 
response. The score was the number of words correctly recalled. 
However the three types of pairs were evaluated separately. 
Especial interest attached to the total number of words of the 
agricultural engineering type recalled as compared with the total 
iniinber of norjjial words recalled. The I’atio of the former to the 
latter was tlie score used in the i*Ggrcssioii equation. Tlie ratio 
was multiplied by 100 to simplify computation, 

Test 8 was an “infoiTnation” test compri.^ing items related to 
agrieultural engineering. Effort was made to select items that 
would not actually be discussed in the class room but with which 
an alert interested student who read current agricultural engin¬ 
eering literature would be familiar. Technical journals were 
used considerably in devising such items. The following are 
typical; 
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1. A ti’flclc laying tractoi* is used for: HOAD ROLLING; 
PAINTING: MILKING: LAYING TRACKS: PLOUGHING. 

2. The best blower belts arc injule of: LEATHER: RUBBER; 
JUTE: SILK: HEMP. 

3. Soil stack is a term used in: BOILER FITTING: SURVEY¬ 
ING; CEMENT MANUFACTURE: PLUMBING: SOIL 
ANALYSIS. 

There wore 20 such items in cnch installment. The subject was 
instructed to iiiulerline the one of the live alterinitivc.s in capitals 
that helongecl in the sentence. The time limit wii.s 2 niiiiutes per 
installineiiL. The score was the niimbor of items correctly marked 
and the maximum total scoro was thus ‘10. 

Test 0 wa.s a modiftcation of Thurstone’s directions Lu.st, Parts 
I and II had the following direction.^: 

If the word contain.^ E, A, and R mark it 1 
If the word contains E but not A and It irark it 2 
If the word contains A but not R and II mark it ’5 
If the word contains R but not E and A imu’lc it d 
Parts III and IV had the following directions; 

If the word contains I, N and G mark it 1 
If the word contniiis I and N but not G mark it 2 
If the word contains I and G hut not N mark it 3 
If the word contains N and G but not I mark it -1 
If the word contains I but not N and G mark it 5 
Each part consisted of 40 words of from B to 11 letters selected 
so as to belong to one of the classes indicated, They were 
aiTanged in B columns and each word was followed by a short 
dotted line for recording the answer. There were alway.s an equal 
mimber of words requiring each sort of response in tlic "part". 
The subject was instructed to read the direeiioii.s, look at the 
samples and mark the words in the .same way. Part.s I and III 
were done in successsion with time limits of 2 and 2^2 minute.s 
respectively and constituted the first installment, Parts II and 
IV were given likewise as the second installment. The score was 
the number correct and the maximum score IfiO. 

RESULTS 

The regression equation is ns follows: 

X =,0021X -f.OlOBX +.0091X +.0133X -i-.0128X 
1 2 3 4 5 6 

+ ,0070X —.0014X —3.1892 
S -9 

■\Vherc XI is the combined vocational score and X2—X9 the raw 
scores in the various tests above described. The weighting of 
Test 7 proved to be zero. The coefficient of mnlLiple correlation 
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Bj (.li-a:.;,) of Lhu wti^hLod sum of lest scores niul the criterion 
may l)e conipiitor] Ihooreticnlly fi-om Ibe partial Coeflicieiits and 
piovcfl (.n !)(' .fit). ]),v actuaJly wei/rbthi^f the orif^iiifiJ scores and 
cnvrelntiu^' witK the eriterion the coefficient is .G2it:.07. 

Tlic extent l(» which the various tests contribute to the final 
weighted score may lie seen frenn Uio following Lalde which gives 
for each test, Llie ctivreliilion willi the criterion ttf zero order, o. g, 
I'l;, mid nlso of Die .sevonll) order with all the oDioj’ tests constant, 

C, g. ri:iri:ii:'ii. 


7\>.st 

Zero order 

Seventh order 

2 

.2-1 

.10 

H 

.:u 

.11 

4 

.211 

.itl 

5 

.47 

..‘>5 

(» 

.42 

.SO 

7 

.nil 

.00 

H 

.27 

.05 

b 

.28 

—.05 


Tciilii fT f! a|i(»!irently curry inoj't of the load. Tlvey linvc 
the highest coofricienlK of zero ortlcr and also the highest when the 
other tests are constant. TetU 7, on the other hand, while being 
fairly good of itself merely dujilicates factors involved in the other 
toats as hIiowi) by the porlial coefficioDt of zero. 

The correlation bctu'ccn /c.v/.v .5 ainl f> }.<! only .15. A regi’es.9ion 
ciqiinlioii was derived using «inly tlieso two tests and is ns follows; 
Xi=,ui2nx.,-t-.oir)7X«-2.fi4. 

The coofllcieiit of multiple correlation RifliG) is thooreticaily 
.hi) suul the same ro.snlL is obtained by weighting the original test 
.'cores. Moreover the wcig-hlcd .sum of Icals .7 and tt correlates 
with the weift'hUid siiiii of tcfitu '2 .—0 to the extent of ,92. So it 
i.s obvious that the two tesDs will give almost as reliable a predic¬ 
tion as the severe. 

Thu technique of partial correlation involves, of course, the as¬ 
sumption of linearity of the origiiml regressions. Those regres¬ 
sions were not Cfnnpiilod to Le.st Lhi.s a.s.sumption. However for the 
two fitiiil multiple eorrelatioii.s of criterion with weiglited sum of 
teats the correlation ratio (I’ta) was computed. In the case of the 
weighted sum of the seven td« for* x on y (y being the criterion) 
is .70, while r as above mentioned is .02. Blakeman's- criterion of 
linearity (using his simplest formula) is 2.1. Theoretically if this 
iii less than 2,5 the rcgro.s.sion maj' bo con-sidorod linear, In the 
case of the weighted .sum of the two tests eta is .74 and Blako- 
mans’s criterion is 2.2. 

Oii rr.slK Ii.r rll.r i.J' Ili'gri’.^iKli.i) in KnMinoiiu.v Dlfi- 

U’il)ml<ins, llitiHfcItilitt, I, aau-a.rfi. 



185 


BURTT-IVES 


That the ability in question docs not consist oi inevo intollig'ence 
hut is definitely specialized is evident from the following. All 
the subjects had, on another occasion, taken the University Intel¬ 
ligence Test—a somewhat inodiFied army alpha. Scores in this 
test eorroiate with the criterion to the extent of only .1G±.10, 
whereas the corresponding eovrelaLion.s for some of the .special 
ability tests are between .40 and .50 and for their weighted sum is 
about ,60. The regression of intelligence on criterion or vice versa 
is distinctly non-linear, for Blcakeman’s formula gives values of 
4,9 and 6.9 respectively. It would tlni.H bo hazai'dous to attempt to 
include intelligence in a regression equation of higher order. These 
facts indicate the advantage in as specialized a vocation as agri¬ 
cultural engineering of devising tests for the specidc purpose in 
question, 

INTERPRETATION. 

If the tests above described are given to an individual for pur¬ 
poses of vocational guidance or selection it is necessary to iutci'- 
pvet the scores obtained. This may be done in various ways. The 
sum of the test scores weighted by the coefficients of tlie independ¬ 
ent variables in the regression equation must of cour.se be com¬ 
puted. This sum may then be taken as the most in’obable voca¬ 
tional ability of the individual and interpreted, relativo to the 
norms, by considering the .standard error of estimate. For in¬ 
stance a normal frequency curve may be drawn with this weighted 
sum of test scores a.s the mean and the standard error of e.stLmatc 
as the standnrd deviation of the curve, or by the use of a tabic 
of the probability integral the chances may be expressed of the iii- 
dividuaRs ability falling within certain assigned limit.s. 

It is perhaps better to develop the interpretation in general 
terms. It is possible with any cori’elation coefficient to derive fz'oni 
the table of the probability integral a ten by ten fold table which 
expresses for any assigned decile in one variable (test) the probable 
distribution throughout the various deciles of the other variable 
(vocation). Such a table may be used to predict what per 
cent of the persons in a given test decile will be in any voca¬ 
tional decile, or to predict for a given individual who scores in 
a certain test decile his chances of being in any vocational decile. 
The table below represents such a di.stvibutiou for a correlation of 
.CO, Some slight adjustments were made to avoid unnece.ssavy de¬ 
cimals, In the columns at the left arc given the limits of the de¬ 
ciles of test scores. The first column gives such limits for the 
weighted sum of the seven tests and the second column for tlie 
weighted sum of the two tests in the shorter vegves.sioii equation, 
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ise 

Test deciles 



Vocational deciles 




Seven tests 

Two testa 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

.80 to ? 

.64 to ? 

42 

20 

13 

10 

6 

4 

3 

1 

1 

0 

.5.3 to .79 

,42 to .63 

20 

20 

16 

13 

10 

8 

6 

6 

2 

1 

.33 to .52 

.26 to .41 

13 

16 

16 

13 

12 

10 

8 

7 

6 

1 

.1610 .32 

.13 to .26 

10 

13 

13 

13 

13 

11 

10 

8 

6 

a 

0 to .15 

0 to .12 

6 

10 

12 

13 

13 

13 

11 

10 

8 

4 

0 to -.15 

OtQ-12 

4 

8 

10 

11 

13 

13 

13 

12 

10 

6 

-.16 to -.32 

-.13 to -.26 

3 

6 

a 

10 

11 

13 

13 

13 

13 

10 

-.33 to -52 

-.26 to-.41 

1 

5 

7 

8 

10 

12 

13 

16 

15 

12 

-.53 to -.79 

-.42 to-.63 

1 

2 

5 

6 

8 

10 

13 

15 

20 

20 

-.80 to-? 

-.64 to-? 

0 

1 

1 

3 

4 

6 

10 

13 

20 

42 


Foi’ exninple suppose an individual scores .65 in the svim ot xne 
seven tests, This places him in the second highest decile. Then 
the chances are 20 out of 100 that he will be in the highest decile 
in the vocation, 20 out of 100 that he will be in the next highest 
vocational decile, 15 that he will be in the third decile, 13 that he 
will be in the fourth, 10 in the fifth, etc. By a decile of voca¬ 
tional ability is meant of course ability like that possessed by the 
given tenth of the group of students on whom the tests were 
standai’di/od, A general tabic like the above is preferable to the 
scatter nlot of the linul It of multiple correlation between weiglit- 
ecl test scores and criterion because it gives smaller increments. 

The above example is typical of the use of the tests for voca¬ 
tional guidance. It makes it possible to tell the student something 
about hi.s chances of success in this type of work If the tests 
are to be irsed, on the other hand, for vocational selection it is 
necessary to .select on the basis of the above distribution table a 
critical ts.st score and admit to the agricultiira] ene’ineering’ course 
only those who ex^eced that score. The probable cn)ibi*e of stu¬ 
dents admitted or I'ejected on the basis of such critical score can 
be determined from the table, If, for example, those with a 
score alg'ebraically less than—.80 are rejected the expectation is 
that none of the highest tenth of vocational ability has been re- 
jeetod but that 42 per cent of those rejected are in the lowest 
tenth of vocational ability. 

Summary 

Mental tests were devised for the purpose of predicting ability 
in agricultural engineering and wei-e .standaz-diaed upon -13 stu¬ 
dents specializing in that subject. The tests were given in two 
installments by means of mimeographed blanks, using the group 
method. Eighteen test variables were evaluated by means of 
three instructors' ratings. These rating's were made on a linear 
scale, reduced to the ratio of x to aiffjna for each instructor and 
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these converted measures averflged for each subject, The final 
selection of tests was based on inspection of scatter plots for the 
IS test variables against the vocational variable. Eight tests were 
retained, correlated with the criterion, intercorrdated and the re- 
RTession equation derived. 

The correlation between the criterion and the sum of the eight 
tests weighted according to this regression equation (one weight¬ 
ing was zero) was about .60. However two tests carried most of 
the load and when weighted according to a regression equation in 
three variables their sum correlated with the criterion almost as 
highly as did the eight. Intelligence, on the other hand, had a 
corrclaiion of only ,16 with the vocational variable, which gave 
further justification of the effort involved in devising special 
ability testa. 

For interpreting the results of the tasLs when given for purposes 
of voeatioiiiil guidance or selection a ten by ten fold tabic for the 
correlation of .00 and its standard error of estimate was derived 
from the probability integ^-nl. Knowing an inf!ivi(lu;d’.s weighted 
lest score it is possible with such a table to state the probability 
of bis attaining any assigned degree of ability in agricultural eii’ 
gineeviiig. 



NOTES AND NEWS 


Third Annual Educational Conference Conducted By Tub 
College or Education, Ohio State University, 

On April 5, G and 7. 


Neai’ly 3^000 Ohio educators took advantage of the opportunity 
to attend the Third Annaual Educational Conference which the 
College of Education, Ohio State University, conducted at Colum¬ 
bus on April 5, 6 and 7. This attendance marked a decided in¬ 
crease over that of 1922 and emphasized, quite graphically, the 
increasing interest which the school people of Ohio are showing 
towards these yearly conferences. 

Three general meetings, 24 sectional meetings, and several ex¬ 
hibits were lumped into the three-day gathering as the formal as¬ 
pects of the conference. In addition to this array, however, there 
were many informal luncheons and dinners of various groups 
which were so successfully attended and so thoroughly appreciated 
that they threaten to become a regular feature of the conference. 

The keynote of the conference was that of '■'Objectives in Educa¬ 
tion” and nil of the meetings were guided by this in their discus- 
Bions, The summary of the nieetinga which will be published at an 
early date are expected, thevefove, to be a valuable'contribution to 
the literature on educational objectives since the discussions 
touched on all phases of education as weil qs on the field as a 
whole. 

One of the interesting sectional meeting.? was that conducted by 
Dr. H. H. Goddard on Clinical Psychology. Dr. Goddard presided 
at the meetings and conducted a Clinic on Lho examination and 
diagnosis of children. Children from the Columbus schools were 
used as subjects. Mabel R. Fernald, director of the vocation bu¬ 
reau, Cincinnati, spoke at this meeting on “The Service a Clinical 
Psychologist Can Render the Public School Teacher-,” and the 
"'Value of the School Psychologist in Personal Work With Pupils" 
was discussed by H. Austin Aiking, Western Reserve University, 
Cleveland. 

Othei' sectional meetings which were held were: biological 
science, commercial education, educational and intelligence tests, 
educational and intelligence tests demonstration, European history, 
high school principals' association, Latin, mathematics, parent- 
toacher’s association, teacher Iraining, American history, art, 
city superintendents, county superintendents, elementary princi¬ 
pals, elementary teachers, English, home economics, industrial and 
vocational education, junior high scliool principals, modern lan¬ 
guage, non-biological science and physical education. 
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One of the attractive features of the Conferonce was the array 
of spealcei's of national reputation who spoke nt the dilTerGnt meet¬ 
ings. Among these were: W. C. Bagley and S. S. Colvin, Teach¬ 
ers College, Columbia University; C. H. Judd and Algernon Cole- 
nan, University of Chicago; L. V. Koos, University of Minnesota; 
I'f. A, Works, Cornell University; J. C. Miller, Indiana University; 

■ nd E. W. Barnhart and P. W. Ballou of Washington, D. C. 

One of those chiefly responsible for the Conference has ex- 
j rcssed himself os follows; “The remarkable attendance is most 
' ncouroging to us in this undertaking to make the Annual Educa- 
'ional Conference a vital factor in the life of the Ohio school sys¬ 
tem, And the concentration of all the meetings on the problem of 
»electing clear-cut objectives has meant a clarifying of the aims 
whicli the Ohio school people are using as a working basis in the 
»aoulding of this system, 

"Wo were especially gratified this year by the participation in 
our educational program by people whose interest is not primarily 
educational, such as the business men who aided in tlie discussion 
before the commercial education and the industrial and vocational 
education grouPiS, and too, the meeting conducted for the parent- 
teacliers' association. This gives us a definite point of contact 
with the people who are supporting the school system and their co¬ 
operation makes it easier for us to plan and conduct our work 
with greater effectiveness." 
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Kntght Dunlap, The Elementn of Scientific Psychology. St. 
Loui-s, C. V, Mosby Co. 1922. 368 pp. Price. ?3,50. 

In this book Prof, Dunlap has attempted to sift from the great 
mass of psychological material that essential residue which will 
he needed by the stiulent of sciontifie psycholoe'y when he comes 
to deal with the world of “real objects and real activities,” While 
in no sense an attempt at applied psychology it is a very decided 
attempt to present the facts of psychology in sucli a way that 
their application will he possible. The book is intended primarily 
for college students, but the author assumes that it will also bo 
found iisufiil Lo the goncral reader who desires to know the fun¬ 
damentals of psychology but has no teacher. 

The general content of the book may be inferred from the 
following resume; A.n introduction dealing with* the nature and 
divisions of jjsychology; four chapters dealing with sense per¬ 
ception, the senses, cand sensory qualities; two chapters on sensory 
relations and sonsoi'y measurements; two chapters on thinking 
and tlioiight processes; one chapter on the bodily mechanism; two 
chapters on reactions and reaction t^pcs; two chapters on per¬ 
ception; one chapter on alfectivc processes; and one chapter on 
the empirical self. Two appendices complete the book: the first 
deals with mejital deficiency and menial disease, the second with 
choice refoi'cnccs grouped under cortain general divisions. 

The following views gleaned from various parts of the text 
illustrate tlie autlior's typical attitudes; Science must be scrupu- 
louslv exact in the use of its terms^ and must furnish experi¬ 
mental proof for all accepted hypotheses. Anecdotal evidence is 
the bane of pseudo science. The term sensuiion is replaced by 
the term Rcntiouhn)! a.*? Iieing le-^a confusing- Stimuli are clnssi- 
licd as physical, unresolved (without mathematical expression,) 
and inadociuate (unusual.) All sapid substances must be soluble 
"in wiiLcr.” Cla-ssificaLions of odors based upon the method of 
exhaustion arc futile, « more hopeful method will follow more 
nearly the chemical method of Ramsay, Color vision is based on 
a .‘flight jiioUification of tho Ymwg^Heimhohz thoory, the cieirten- 
tavy colors of which arc red, blue, and chlor (yellow-green,) The 
pigmental cells of the retina protect the receptors from too great 
stimulation in strong illumination. Pitch is the exfccnsity chai’oc- 
Ler of tones, and depends upon the degree to which the entire 
tectorial membrane is excited. Pilch dilferencos at first imprecep- 
tible are readily prcceptiblc after sufficient practice. The ampullar 
and vesLibulur receptors of the ear have no true sensory function, 
but give rise only to reflexes in skeletal nniscles. Weber’s law 
is responsible for the failure to determine many inucli needed 
constants of range and threshold values. The term conditioned 
reflexed as frequently used is a misleading term. The contrast 
between instinct and habit has been ovorstressed in the past. 
Intelligence ia a terjn having many meanings, and as far as it 
relates to intelligence teals may be defined as "whalever intelli¬ 
gence tests measure." Sound localizations in the median plane 
of the body are made possible by timbre nlone. The semi-circular 
canals arc of doubtful function in equilibration. The eye is blind 
during the saccadic movements of the eye, us in reading. Mean¬ 
ings do not essentially depend upon muscular movements. Asso- 
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dation is only a special case of habit formation, and occurs in 
exactly the same way as does nil serial connections. 

Throughout the book the author is vigorous and stimulating; 
his language is not involved and one cannot avoid catching his 
vfhctUcir he agrees with it or uoh While the author has 
given credit to all authorities cited he hns not done so in a 
way which would permit the reader to refer to the original sources 
without considerable di/BcuIty. This omission might bo a serious 
handicap to the general reader who knows little of the psycholo¬ 
gical literature, in fact the serious student of psychology would 
feel a little more at ease were the opposing views set aside with 
more opportunity to investigate the sources of authority. All in 
all the book is well worth reading because it is so different from 
the usual presentation, if for no other reason. 

Ohio University C. H. Growdon. 

Robert MacDougaix, Ph. D., The General ProblemB of Psi/- 
cholooif, The New York University Press, New York City, 1922, 
jpp. 46-1. 

That npplictl science must be grounded in solid general scien¬ 
tific principles is obvious. Almost as obvious is it too, that general 
science must be based upon satisfactory mctliodological principles, 
although this latter situation is frequently ovcrloolcecl. Too Tnuch 
by far of ouv scientific work is conceived and executed witli faint 
or no regal'd to the indispensable mothodologicul background. In 
consequence our science is not nearly so free from serious de¬ 
fects as it might be. 

In psychology especially must the methodological background be 
constantly kept in mind, for not only is psychology concerned with 
phonoiueiiH which arc the most difllcult of any to investigate, but 
also psychological science is, more than any other, a direct de¬ 
rivative from more elementary ways of thinking, 

To the thoroughgoing anoly.sis of the methodological perspective 
of psychology Professor MacDougall devotes the present volume. 
Vevy elearty ht out how aonows mii\ ubslYxictWe nro 

the misconceptions which arise when psychologists arc not fully 
oriented with respect to the nature and purpose of the concep¬ 
tions guiding their w'or*k. “The individual may be an acute ob¬ 
server or a patient scholar, but, if the guiding assumptions of his 
work be mistaken, the force of every gift he posses.ses further 
subverts the purpose of research and hinders progress. The 
work done under such conditions is not merely negative. It is an 
obstacle set in the way of knowledge, whose oeriouancsn is nvouov- 
tionate to ita bulk.” 

The more positive results derived from a thorough acquaintance 
with the luethoclologicnl presuppositions which the psychologist 
uses, not only make for rapidity and security of scientific advance, 
but also iiisuve the avoidance of insidious misconceptions. Pro¬ 
fessor MacDougall in the following quotation enumerates some of 
these misconceptions vrhich have been made in the past, "The 
mind's activity is not deterinined by a sufficient body of induc¬ 
tions to make its speculations rational. Fantastic hypotheses are 
shaped. Gross perversions of the meaning and scope of science 
arise. Methaphysicnl and theological concepts invade its terri¬ 
tory, The thinker tm-ns from the patient exploration of fact 
to spin deductions from a system of a priori definitions. Fact 



BOOK REVIEWS 


192 


and myth are interwoven in a new unitary complex. The natural 
connections of cause an(l_ effect are supplemented by essences 
and forms, magic and miracle, as method shifts iinpredictably 
between theological hitci’pretation and explanation in terms of 
natural law.” 

The treatment which Professor MacDougall gives to the general 
problems of psychology is at once comprehensive and thorough. 
He discusses not only the relation of psychology to knowledge 
in general and to the arts of life, but the field, the limits, the 
methods, data, and specific problems of psychology. It is not 
necessary to bo in full agi’Gement with Professor MacDougall to 
appreciate that this book is of considerable importance and well 
worth the perusal of every serious student of psychology. 

A. A. Rohack, Behaviorism and Psychology, University Book¬ 
store, Cambridge, 1923, pp. 284. 

As its title indicates “this book has had for its purpose the 
confutation of the claim of behaviorism to the title of p.sychology." 
Although the author summarizes his destructive efforts in the 
following statement, that statement does not convey in full force 
the severely critical judgment he really entertains of the behavior- 
ists. 

“I have tried to show that (1) the concept of behavior is too 
general to afford us the foundation for a separate science, (2) 
behaviorism, in its restricted sense, seeks arbitrarily to dominate 
a field which is not, cx hyptliesi, under its jurisdiction by bowing 
out of court everything which does not fit into its narrow frame 
work, and (4) behaviorism does not readily lend itself to appli¬ 
cation.” 

ITow then is the work of destroying such a "general" and worth¬ 
less movement ns behaviorism carried out? Briefly, by putting all 
the behaviorists into one group and attacking all through w^iat 
the author considers the weakest point in each of the very few 
that he slightly examines. 

Similarly, behaviorism is deprived of all applicational value 
by the simple method of assuming that only mentaiism is psycho¬ 
logy. In conseciucnce of this fact, it is asserted that if one wishes 
to handle situcations involving intention, belief, intelligence, ideas 
and emotions, or other such psychological facts, behavioi’ism can¬ 
not be of any service at all. 

Indiana University. J. R. ICantor. 

Edward Allswortii Ross, The Social Trend. Century Co., New 
York, 1922, pp. xxii and 235. 

War, prohibition, "philanthropy with strings,” women in the 
home and in a man-made world, mi^-ation, the vanished frontier, 
the birth and death rates, a legal dismissal wage: such are some 
of the topics considevecl in this collection of papers, It were vain 
to call it a book. 

Written with nil the vei‘y great attractiveness of Professor 
Ross’ style, fearless, filled with intei'esting views, the volume 
deserves a wide reading. 

Perhaps none of these papers is more acute than the one on 
"The Legal Profession from the Social Point of View” or the fol¬ 
lowing one on "The Conscience of the Expert.” It is shown that 
the skill of able law^^ei's retained by the wealthier, and when 
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wrong' more reckless side, tends to whittle down the defenses 
of the law. The lawyer is in large measure engaged in an anti¬ 
social underfcalcing. Compare with him the true exi)ert, the i)rQduct 
of modern training in scientiAc method, |iosso.s.sing the scientists 
love for truth and you have almost a complete antithe.sis, The one 
aims to establish n point oi view, his side, whetlier true or false, 
against the assaults of his brother lawyers! the other to wre.st the 
truth from natuYO and repoiT it. Society shouUl und will make 
more use of the scientiAc expert, not so much because he has a 
special method or special knowledge, but bociuise he h:is a con¬ 
science sensitive to truth. So be it. 

All of these papers deserve inclusion in the collodion and their 
very variety serves to indicate the diversified social trends of a 
complex social order. 

D, F, Haugiit, The hiterrolaiion of Some Higher Learning Proc- 
oses. Psychological Monographs, “Whole No. 139, Princeton, N. J. 
Psychological Review Co. 1921. pp. vi and G9 

This is a study, with very complete statistical discussion, of 
aome so-called higher learning processes, "riiLional lenming,” 
"checker puzzle," "Tait labyrinth" and others, and a comparison 
of the results of those with the results from the Stanford-Binet. 
The intei’correlatior.'* are low and conAicting and the conclusions 
arc therefore adverse to the Spearnmn "Two Factor Theory" of 
intelligence. Are logical conditions and factors in learning' on the 
whole less determinative than such matters as emotional stability 
or disturbance, perseverance, self-control and so forth? 

The Professionul Education of Teachers in Cle^lcland. Cleveland, 
Ohio. Division of Publications, The Board of Education. 1922. 
pp. X and 92. Price $ .BO 

We have here the report of the Educational Commission which 
was appointed to study the subject iramcd m the title. This Com¬ 
mission was composed of Professors W. G. Bagley, J. W. Withers 
and Geo, C, Chambers. The pamphlet discusses and inukea rec- 
oTnTnendations oxi the affiliatton between the Cleveland School of 
Education and the Western Reserve University. It considers ad- 
mi.ssion, organization, curi'icula, Anance and other ]'*roblems nnd 
gives in appendices a mirnhei' of documents which show require¬ 
ments and organization of this important joint venture in the 
pre-.service and in-servico ti’alnine of teachers for a great city. 
The report is on important contribution to cui’X'ent discussion of 
teacher training. 

R, G. Jones, Survey of Department of Instruction of the Cleve- 
hmd Public Schools. Cleveland, Ohio. Division of Publications, 
Board of Education. 1922. pp. 29. Price ,50 

This is the Arst of a series of continuous surveys to be conducted 
by the Department of Research of the Cleveland Schools. It 
provides a brief analysis of the educational operation of the 
school system. There are diagrams and tables on enrollment, pro- 
niotion, age-grade conditions, nehieveraents in individual subjects, 
the work of the psychological clinics, etc. The material was ore- 
pared under the .direction of Dr. \V. W. Theiseti. 

Arthur I. Gates, The Psychology of Retidiuo and .Spellinp, 
with special reference to disability. Teachers College, Columbia 
University Contributions to Education, No. 129. New York, 
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Teachers College, Columbia Univei-sity, 1922, pp. vlii & 108, 

It is sixteen years since Huey published his excellent summary 
oI the psychology and pedagogy of reading. Since that time 
a great quantity of experimental and clinical work has been clone 
in the field of voading, speech and spelling; and in consequence, 
it is becoming apparent that the difficulties involved are only 
now slowly emerging, The solutions arc still to be sought, 

The present investigniion was carried on at the Scarbrough 
School, Scarborough, Now York, Dr, Gates had the good fortune 
to work with a group of pupils of normal or superior intelligence 
but who yet inanife.qled the reading or spelling difficulties which 
.form the subject ol study. A number ol group tests of general 
mental ability, of achievement in school subjects, of responses to 
a variety of visual and auditory stimuli and of several sensory 
mechanism.^ and motor responses were given to a group of one 
hundred pupils in grade.s III to VIII, Detailed individual testa 
of inental ability, as the Stanford-Binet, and of specialized abili¬ 
ties in pronounciation, word perception, etc., were also given. The 
investigation was carviccl out with considerable detail and great 
cave. 

In a short review it is impossible to make any adequate report 
of the study. In the first part of the volume it is shown that 
there is an ability common to reading, the recognition of correct 
spelling, proof reading, and the ability to detect differences be¬ 
tween pairs of siinilar words. It would seem that both for pre¬ 
diction and for diagnosis the value of any one of these tests is 
minimized by the fact that they are applicable only througli the 
use of material which ha.s already been learned; and that the 
wortli of showing tJiat there are psychological elements common 
to reading and proof reading, for example, is not great. 

It appears that the most fruitful portions of the study are the 
short reiiorts of individual difficulties in reading and spelling. (See 
pp, 41-42 and 66-G7, etc.) It may at least he seriously questioned 
whether we will ever get very much further with group studies 
of reading defectives until after we have made more detailed 
and critical studies of a large number of Individu-al cases and 
defects. 

An interesting conclusion, in view of the work of Huey and 
his successors, is the statement that inappropriate eye move¬ 
ments are not the cause but only a symptom of poor reading, and 
even then, not the symptom most easily observed, (p. B7) 

Concluding chapters deal with an analysis of abilities involved 
in spelling and present criticism of various theories of the causes 
of backwardness in reading and spelling. 

Perhaps the most important conclusion of the study—and it 
is certainly an important one—is that presented in the following 
sentences: “A case of inability to read affords, frequently, a 
tangle of difficulties that experts from several professional fields 
working together may be unable to disentangle. Such a situation 
portrays clearly tlie need of a new group of specialists who will 
make the solution of such problems their main work." (p. 106) 

Ohio University H. G. Good. 
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Henry E. Jackson, Robinson Crmoe, Social Enr/ineer. E. P. 
Dutton, New York, 1922. pp. 301. Bibliography of more tlian 
CO titles. 

The author divides discussion into three parts. In part I he 
describes at length the character of Robinson Crusoe. He see.s 
in him n typical Anglo-Snxon actuated by tlio go.spel of work and 
of courage. Crusoe is represented as meeting mimorous discoiir- 
agements from which he Uu*ns unshaken and vmafvaid. 

In part II the author presents certain essential characteristic.^ 
of the industrial situation as it is found today. The author main¬ 
tains that the source of the difiiciilLy i.s found in the fact that the 
principles of feudalism control industry today, Industry fails to 
recognize the equality of man a iirinciplo which has been rec¬ 
ognized for more than a hundred yoara in politics. He cloclarea 
that industry in this particular is a century and a half behind 
politics. Politically men are equal but industrially the old re¬ 
lation of lord and vassal maintains. 

In part III the author proposes a solution for the industrial 
problem, In brief he declares that the .solution will be reached 
when a new attitude of mind has taken possession of those who 
supply capital and those who supply labor. This new attitude of 
mind must recognize the principle of manhood—the right of each 
individual to a proper return upon his investment whether this 
be in terms of capital or labor. In a word it is a plea for in¬ 
dustrial democracy. 

The book is full of optimism and faith in the future. The author 
does not attempt to list successful applications of the new doc¬ 
trine. He is concerned only with the presentation of a principle 
of conduct. His discussion is clear and compels consideration on 
the part of the reader, 

Frank G. Pickell, Junior High School Mathematics. Cleveland, 
Board of Education, 1922, 

This is a course of study and syllabus for mathematics in the 
Junior High School in Cleveland. In this syllabus material suit¬ 
able for maLhematics in junior high schools has been organized 
along lines independent of the traditional organization. In the 
7hh grade graphs, fundamental processes, business forms and 
accounts, equations, and percentage with its applications, are 
outlined, In the 8th grade the fundamental processes of arith¬ 
metic are further considered and advanced work in the application 
of percentage as well as intuitive geometry are treated. In the 
OHr grade emphasis is placed upon algebra. In the treatment of 
algebra in this grade one important change from the traditional 
sequence has been made; factoring and simultaneous equations 
change places, “This change has been made first to stress at the 
outset the equation as the most valuable tool in the solution of 
problems and second to prevent the wa-ste of time to the OB 
pupils." 

Kline-Carey. The Revised Measuring Scale of Free-hand Draw¬ 
ing. The John Hopkins Press, 1923. Price $ .GO. Baltimore, Md. 

This is a revision of the authors' earlier scale for measuring 
free-hand dva.wing. The revision presents a scale for measuring 
achievement in the drawing from memory of distinct types of 
objects. These objects are: house, rabbit, figure in action, and 
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tree. This has made the merit of furnishing an instrument for 
measuring achievement along special lines. 

Ohio University. W. L. Gard. 

William T. Root, Jr, A ^ocio-Psycliological Study of Fifty- 
llirp.e Supcvnormat Cfiilclren. Psychological Monographs Vol. 
XXXIX, Psychological Review Company, Princeton, N. J., and 
Lancaster, Pa. 

This study of supernormal children was undertaken because the 
author felt the importance of the Superior Child to the state and 
because the lack of information concerning the factors making 
for superiority give the subject peculiar’ interest. The aims of 
the study are mainly to compare the behavior of the superior 
child with that of the normal child; to note the individual 
differences of the superior mind in methods of procedure, imagery, 
associative and mnemonic devices; the qualitive character of 
their responses; and to try to discover the significance of definite 
systems of training, by incidental education, and the social 
milieu. 

The children for this research were selected from the city of 
Los Angeles. The preliminary selection was made thru the schools, 
newspaper accounts, etc. The final selection was based upon the 
results of Binet Tests scores and special ability along some line. 
Several tests were used in the experiment, such as Binet Letter- 
Square, Trabue Completion Test, Healy-Fernald Construction 
Puzzle, Proverb Test, etc., and the different phases of mentality 
studied. Not only the Psychological test given to discover the 
inental ability of each child were studied, but the social histories 
were thoroughly investigated. The effects of home life and 
training upon the mental development of each child were carefully 
considered. 

The author's conclusions are most interesting and valuable to 
the research student in this field. Mr. Root has reserved no time 
and energy in stating clearly what he discovered in this work 
with bright minds. 

Ohio University LaVinia Warnkr. 

Thomas Verner Moore. PERCY BYSSHE SHELLEY, An In¬ 
traduction to the Study of Character. The Psychological Mono¬ 
nograph, Vol, XXXI, No. 2. Whole No. 14, 1922. 

This monograph is an important and stimulating endeavor to 
apply the literary-historical method of psychoanalysis to Shelley. 

In the author’s analysis of the mentality of the poet he finds, 
first of all, the "precox elements of negativism and defense.” He 
is firmly of the opinion that Shelley's plan of life, or its chief 
di’iving force consists of an "affective drive for an object of 
sensuous love” and an intellectual drive colored by protest. 

In the development of his thesis the writer seems to insist upon, 
the idea that the prime dominating motive force of Shelly’s life 
was his yearning for a beautiful woman who could unreservedly 
appreciate him and his poetical capabilities. In support of this 
view he draws chiefly upon Alastor. However, a question of 
once arises as to whether this poem should receive the inter¬ 
pretation that Mr. Moore appears to give it. Critics have largely 
agreed that in this significantly autobiographical poem the Poet's 
quest of the lovely maiden may be any poet's quest of ideal 
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beauty_such beauty as is celebrated in the Hyvin to IntellecLual 

Beauty. And although one readily concedes tliat Emilia Viviani, 
more or less directly inspired Epipsychidiou, one much prefers tO' 
g-ive the later poem a spiritual rather than a literal signification, 
Shclloy here emphusiKGs n fact so often expressod by him that a 
poet must ever seek the elusive beauty of life and poetry and 
that when he attains to such only disappointment and faiUiro must 
ensue, The ideality and unrealized end of the pursuit are the 
agencies impelling a poet. Had the Poet in AUmtor atLiiiiied the 
alluring object of his love he would have experienced defeat in 
the very fact of- his realization; only the conliiuioii.s striving 
toward her brings richness or reward. 

As a potent influence in Shellcy'.s life Mr. Moore cites -the 
poet’s relationship with Harriet Westbrook. He finds little justi¬ 
fication for Shelley’s conduct. It is to be admitted that even the 
most enthusiastic admirers of Shelly cannot nialce an aUogetlier 
satisfactory brief for him. However, it is gratifying to the 
lovers of Shelley to note William Sharp's a.ssiirancc that Shelly's 
"sorrow and life-long regret for the malfortunale outcome of 
his action were genuine.” 

Mr. Moore well points out the clement of protest in the poet's 
character. But one questions whether this factor is wholly, or 
even largely, due to the "father complex,” One is inclined to 
hold that the Sion House experience, more than any olhei'j en¬ 
forced, If not implanted, Shelley’s hatred of tyranny. Unques-'' 
tionably there is some difTerenco of oiiinion as to the jioet’s home 
relationships; but all agree as to the extreme distress he sufl'crcd 
at Sion House. Mr. Moore draws upon tlie Promotheua myth to 
illustrate his convictions in this instance. 

The Prometheus theme, a very popular oiiG in literature, per¬ 
haps cannot be summoned to demonstrate anything peculiar to 
Shelley. True the poet employs it as a medium for his expression 
of the overthrow of all forms of tyranny and hi.s in.stnllation- of 
the Golden Age. Demogorgon, a name which in the drama no 
longer carries any connotation of magic, is by the poet dedned ns 
“Eternity.” Shelley has not identified him with mere Necessity 
because he too strongly personalizes the character; for instance, 
the closing pronouncement of the last act. The poet’s dream 
reaches its most vivid delineation in the eternal union of Love 
and Humanity, 

Chapter IX of Mr. Moore’s article contains a brief analytical 
summary of the Shelley profile. It is reasonably comprehensive. 
As has just been indicated one is inclined to differ from the latter 
test against all authority rooted unconsciously in the hatred of 
portion of the second predication, namely, “The bold, violent pro- 

Books and pamphlets for review should be sent to James P. 
his father.” Perhaps one might suggest that greater emphasis 
sliould have been ijlaced on Shelley’s generosity of soul. The 
philosophical-religious aspect of the poct’.s mind has not been 
noted, _ On an earlier page Mr. Moore refers to Shelley’s homo¬ 
sexuality. Fortunately this is omitted in tho profile, It -would 
be difficult to detect this element in Shelley’s mental constitution. 

Mr. Moore’s careful and scholarly work is, in most respects, to 
be warmly commended. He has given us an elTective attempt to 
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nscertain the mental traits that most palpably have revealed 
tliemsclvGs in the operations of Shelley’s iniiul, 

Ohio University Hiram R, Wilson. 

The ifoiiC8l|/ Book. Prepared and published by The National 
Honesty Bureau, 115 Broadway, New Y.ork. 

A textbook for schools written by business men instead of by 
pedag^ogues, a good idea. Hitherto the most recent illustration in 
schoolbooks of bijsines.s honor have been talten from such 2 ‘oinote 
examples na Benjtunin Franklin and Peter Cooper. This little 
hook bogina with d talk about a modern oflicc-boy, tells how a 
young innn today gets a bond an<l it is replete with references to 
the business practices of our own lime. The Notional Surety 
Company has originated the plan of reviving the commandment. 
"Thou shalt not steal,” in the schools und has had the stories and 
methods tried out successfully in real schools by teachers with 
actual pupils. The .stoiie.s arc ci’isp, pointed, unconventional and 
avoid the goody-goody. 

The volume Is an interesting attempt to demonstrate how a par- 
'ticulav virtue may be inculcated. Its suggestions give promise of 
being helpful to teachers in teaching other virtues. The book 
ami the cainpuigii of which it is the instrument are to be heartily 
commended. 

Ohio University James P. Porter. 
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THE RETURN COUPON AS A MEASURE OF 
ADVERTISING EFFICIENCY 


By a. T. POFFBNnEUGEn 
Columbia University 


When UiG psychologist offers a device for mensuring the effect¬ 
iveness of ndvcrtisoments, sucb as the Order of Merit Method, or 
one of the Attention or Memory methods, it should be evaluated 
not in comparison with some ideal mpthod but rather with the 
other actual methods in use with which it would have to com¬ 
pete. In investigating current methods of measuring advertising 
e/Ticieucy the writer was surprised to discover the reliance which 
is at present placed upon the return coupon as a measure of the 
value not only of a particular piece of advertising copy, hut of 
an adverti.sing medium which carries the copy. This reliance 
seems not to he limited to cases of strictly mail order selling, 
but is extended to cases where the product may be purchased 
directly in any locality, and where the I’eturn coupon concerns 
merely samples ov descriptive literature. Publications have been 
known to lose valuable clients because the number of "replies" 
through that medium do not come up to expectations. There 
must be many factors determining whether readers of a particular 
medium will or will not indicate their interest in advertised 
articles by filling in and mailing a retuim coupon. The price of 
a magazine as well as the nature of its contents, determining the 
charactei’ of its readers; its editorial policy such as that of ad¬ 
vocating buying from local dealers; the distribution of readers 
in city and counti-y; all may give clues to the possible attitude 
of the reader toward the return coupon. In addition to these, 
there are other more strictly psychological factors involved. 
These, lilce most others which determine the human reaction to 
advertising, can be discovered, by painstaking research. This 
report deals with conditions that are not peculiar to any one 
medium, hut rather with the olfectivencsa of the return coupon 
in general. Two of these will be discussed, namely (1) the de¬ 
pendence of elTectiveness upon attention value, and (12) the cic- 
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pendence of elTectivencsa upon ease ol UBing the coupoi\. 

1. A casual survey of any magazine will provide abundant 
evidence of the Incl; of attention-getting power in the return 
•coupon. Its size ia usually reduced to n minimum; its position 
is at the extreme bottom of the adverliacmcnt or in a lower 
■corner, with none of the ettatomary mechanical devices employed 
to carry the eye to it; its typo ia small and plain. It would seem 
that a reader might well have Ms interest nrousctl in the article 
advertised and yet fail to be stirred to action by the appeal of 
the coupon, or worse still might foil to notice the coupon nt nil. 

To test the attention value of return coupons in comparison 
■with the advertisements that carry thorn, n simple experiment 
■was nvranged. Six fviU page ndvertisementa (black and wMte 
only) were taken from the October 14 issue of the Saturday 
Evening Post. Three of these contained return coupons of the 
usual sort, while the other three had none. This set of six 
advertisements was presented to 210 persons each of whom was 
asked to examine them ns much as he liked, but move carefully 
than he would in looking over o magazine. Immeclintcly after 
this examination was finished, the advertisements were withdrawn 
and each person was asked to write the names of the articles 
advertised. The test was made extremely easy by using only six 
advertisements and testing for knowledge of them immediately 
after so that as large a proportion of the people tested as pos¬ 
sible should vemember all of them. That most of the persons 
did remember all the advertisements may bo seen in column 3 
of the accompanying table, where 189 of the total of 210 re¬ 
membered the advertisement making the lowest score and 202 
of the total of 210 remembered the one making the highest score. 
Tt will be noticed that the six advertisements were nearly equally 
•well remembered. 

As soon as the names of the articles advertised had been 
■written, these sheets were collected, and others. containing a 
■printed list of these articles were given to each person with in¬ 
structions to check those articles whose advertisements had re¬ 
turn coupons. The results of this test are given in the table. 
The firat column gives the name of the article advertised, columns 

2, 3 and 4 give the number of persons who recalled each ad¬ 
vertisement. The scores for men and women fire reported separ¬ 
ately, in columns 2 and 3 and are then combined in column 4. 
^Columns B, 6 and 7 give the data for the recall of the coupons, 
S and 6 giving the records separately for men and women and 
'7 combining these into n total score. The jirat three adverlise- 
■ineuts •in i/ie table conta-ined return coupons 'lo/iilc the fast tkree 
eojitained no coupons. The lower right hand corner of the table— 
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figures followed by an (*)—represent the eases where ad¬ 
vertisements were said to contain coupons when they really did 
not. Disregarding the records for men and women separately, 
we find that 30, 66 and 51 persona reported falsely concerning 
the presence of coupons, These figures indicate the degree to 
which guessing occurred, and furnish the means for calculating 
approximately how much guessing occureci in the case of ad¬ 
vertisements which really did have coupons. This may be done 
roughly ns follows; It will be observed that the last three ad¬ 
vertisements were recalled by B92 persons and of these 116 or 


NUMBER OF 

RECALLED 

RECALLED 

PERSONS WHO ADVERTISEMENTS 

COUPONS 


advbutisbments 

WITH 

COUPONS 

(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

Articles Advertised 

Men 

Women 

Both 

Men 

Women Both 

Pleischman's Yeast 

B1 

109 

190 

40 

68 

108 

Booth's Sardines 

82 

110 

192 

18 

31 

49 

Underwood Bookkeeping 







Machine 

83 

106 

189 

22 

33 

55 

Total 

246 

325 

571 

. 80 

132 

212 


ADVERTISEMENTS WITHOUT COUPONS 

Styleplus Clothes 

88 

111 

199 

144 

16* 

30* 

Squibb's Products 

86 

105 

191 

25* 

30* 

66 * 

Apollo Chocolates 

91 

111 

202 

12 * 

19* 

31* 

Total 

265 

327 

592 

51* 

65* 

116* 


about 20 per cent said they contained coupons when they did 
not. The first three advertisements were recalled by 671 persons 
and of these 212 or about 40 per cent said they contained cou¬ 
pons. But some of these persona must have been guessing and 
we may assume that about the same proportion guessed here as 
in the case of the last three advertisements, namely, 20 per cent. 
Making this correction, it would appear that only about 20 per 
cent of the people who recalled the advertisements recalled whether 
they had return coupons. As our correction for guessing is 
conservative, this 20 per cent is more likely to be too high than 
too loyr. 

Since the ultimate measure of the value of an advertisement 
is the number of purchasers it ci’eates, the return coupon as an 
indicator of effectiveness should register more than 20 per cent 
of the attention and memory value of the whole advertisement. 
By giving it some of the attention power devoted to the rest of 
the advertisement, it might be made to register more nearly the 
Value of the advertisement or of the medium in which it is placed. 
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Certainly if much reliance is to be plncccl upon the coupon to 
indicate these values some effort should be made to bring it to 
the attention of the reader. 

The figures in the table showing the recordn for men and women 
separately both in the recall of advertiseineuLs and in the recall 
of coupons show only one difference worth noting. In every case 
the scores for women are higher than for men, n difference that 
is usually noted in testa of this sort, But the proportion of 
coupons recalled to advertisemenUs recalled and the pro])ortioa 
of guesses does not differ materially for the two sexes. Likewise, 
no particular significance is to be attached to the difference in 
scores of the different advertisements. They were too few in 
number to enable conclusions to be drawn about the value of 
types of coupons etc. The high coupon score for the Fleischmnn 
advertisement is probably due to the large element of guessing 
in that case, but this cannot be deLermined definitely from our 
records. The iufiuence of diffcrencQ in size, position and layout 
of coupons is a matter which would be well worth investigating, 

fi. The second condition upon which the effectiveness of the 
return coupon depends is the ease with which it may be used. 
There are a number of factors that might well be considered here, 
For example, the paper on which the advertiseinont is printed 
may be too smooth to permit of pencil writing and too porou.s to 
permit the use of ink without its blotting. Again, if not perforated, 
the coupon may tear in being removed from the advertisement. 
These are difficulties probably inherit m the medium and wliich 
cannot be remedied. But there is another, which can be more 
easily handled. This has to do witli the amount of space allowed 
for writing the name and address on the coupon. A glance at a 
collection of coupons will show that many of them uro entirely 
too short to receive an ordinary signature. Now, it may seem at 
first a very small matter to expect the reader to reduce his hand¬ 
writing sufficiently to meet the coupon conditions. Still, it must 
be remembered that in many cases, if not in the majority of 
them, the decision to react or not to react by filling in and mailing 
a coupon hangs on a very slender thread, The resistance which 
any slight obstacle offers may be just enough to sway the re-action 
i\\ the negative direction. 

A series of measurements was made of a random collection of 
110 signatures, and a series of 43B return coupons, some of them 
from full page and gome from half page advertisements in large 
size periodicals such as The Ladies Homo Journal and the Sat¬ 
urday Evoniny Post; others wore taken from full page and Imlf 
page advertisements in standard size magazines such as Scribners 
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and tlio Centnrji' Magazine. ,Thc spaces aUo^ved for both the 
signfttiu'cj and the address were measured but only the former will 
be discussed. The nocompanying chart will show graphically the 
degree to wiiich the spaces fall short of accommodating the sig¬ 
natures. The liorizontal scale for every curve represents the 
leiigtli of the slgunturos ami the stg-natui'C spaces in centimeters, 
and the vorticnl .scale represents the number of cases of a given 
length. Tlie topmost curve shows the distribution of sifjnatnre 
lengths, ranging from about 2.B cm., to about 11.5 cm,, with the 
medifin length at G,9 cm, The second curve shows the distribu¬ 
tion of signature spaces in'Coupons from full page advertise¬ 
ments in large size maguzinca; the third, in coupons from half 
page advertisements in large size magazines; the fourth in cou¬ 
pons from full page advertisements in standard magazines; and 
ti\e fifth in coupons from half page advertisements in standard 
size magaziiioa. The solid line representing the median length 
of the signaliires is carried down through the other curves, whose 
own medians are represented by dotted linos. Although there 
are a few coupons with enough space to accomodate the largest 
names, the median of the names is considerably larger than the 
medians of any of the spaces. The relationship may also be 
expressed in term.s of the p<vr,ccnt of the signature spaces that 
equal or exceed in length the median of the signatures. These 
figures are given below, 




Median 

% Reaching 



Length 

or Exceed. 


No. Cases 

in Cm. 

Med. Name 

Signatures 

109 

6.9 

20 

Full page Ad. 

Large Size 133, 

6.D 

20 

Half page Ad. 

Large Size 55 

4.9 

20 

Full page Ad. 

Standard Size 116 

6.0 

20 

Half page Ad, 

Standard Size 22 

5.3 

0 (Approx 


If the distributions of the spaces were equal to those of the 
signatures, there should be BO per cent of the cases of the former 
exceeding the median of the latter. Thus in three of the cases, 
30 per cent of the names arc too large for the spaces, and in the 
fourth case, they are about all too large to go in the space pro¬ 
vided. There appears to be an even gi’eater discrepancy between 
the height of writing space provided 'and the height of space 
needed for the signatures, although no actual measurements have 
been made to support this statement. 

That the space allowed for coupon purposes is not limited by 
the size of the advertisem,enL is clear from the fact that the coupon 
in the standard magazines tended to be larger* than that in the 
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large giz® magQiine, both for the full and half page advertise- 
nients (medians of G^O and &>3 compared with medians of 6.D and 
4,9). Tiie real reason in to be sought in the failure to recognize 
the importance of providing adequate space. Aduita have their 
writing habits firmly catublishcd, bo much bo that writing a aigna- 
tuve or an addreas is quite automatic. Interference with the 
smooth Gow of the DUlomatic responses when once begun, arouses 
resistance and an unpleasant feeling-tone. This is illustrated in 
the well-known Downey tests for character traits in which the 
subject is asked to reduce, enlarge or otherwise alter the character 
of liis writing, and in which the measure is in terms of resistance 
encountered in complying with the instructions. Now, it is just 
this unpleasant feeling-tone which the advertiser tries in so many 
other ways to avoid, e.g. by the use of' beautiful illustrationSr 
beautiful color combinations, graceful border treatments, appro¬ 
priate type faces, etc. The coupon, if it is to be relied upon or 
used at all, should certainly nob he permitted to defeat its own pur¬ 
pose or the purpose of the whole advertisement by allotting too 
little space to it. 

This brief study points to three conclusions, namely, that the 
return coupon cannot adequately measure the eifectivenesa of an 
advertisement or n medium, except in direct mail selling, because 
of the complexity of factors on which reaction to it depends; that 
ns used at present it lacks sufficient attention-getting power to at¬ 
tract more than el small portion of the readers of the advertise¬ 
ment; and that in tho size in which it most commonly appears it 
is likely to croEite an unpleasant feeling-tone because of inadequate 
space allowed for writing, 



FLUCTUATIONS IN MENTAL PRODUCTION WHEN 
MOTIVATION IS THE MAIN VARIABLE 

By F. B. KniCIIT nnd 11. II. Rkmmerr 

GAP BETWEEN POSSIBLE AND ACTUAL PRODUCTION 
IN COLLEGE STUDENTS 

No one knows with useful accurncy jusl how Kroat is the gap 
between the potential capacity of li colleg-e Ktiidont nnd his nc- 
complishment in college courses. There are, no doiil)t, many stu¬ 
dents who, if we make a rough use of Praiizen’s Accomplishment 
Quotient, possess 100 units of potential capacity and whose ac¬ 
complishment in college work 1.4 appropriately 100 \iiuts. These 
nre efficient students, for there i.s a ncg-ligible gap between potent¬ 
ial power and mental production. On nn invested capital of abil¬ 
ity the yield is satisfoctovy. 

There arc other students %vho possess say 100 units of capacity, 
but whose mental production is 80 units, or 70 units, or even prob¬ 
ably 50 units. These students do not do us much ns they shouiil 
when their ability to work is considered. We might very well 
suppose that three students have 100 units of potential powi^r 
each, and one of the three turns in 98 units of work; another 84; 
and the third 70 iinita. The second and third are not then doing 
the ninount or quality of work we can fairly expect In tlic light 
of their potential capocity. They are not doing mental work ef- 
fecLively, 

In our Jiigh schools we are rapidly getting our requirements for 
individual students on a scientific basis. Pupils with approxi¬ 
mately equal mental ability must do appi'oxiniate work. The same 
quantity or quality of woi'k to be produced by three pupils, sny 
80 units in each case, is not estimated a “B” for all students ir- 
respoDtivG of their difference of ability. A student with 120 units 
of ability who hands in 80 units production may be failed, whereas 
60 units of production by a student of 100 units of capacity would 
be judged as creditable work, nnd one of 80 units production with 
nn 80-uiiit mind should receive definite comn\cndcition for his 
work,' 

The college instructor is a genuine teacher to the extent that the 
gap between potential power and actual accomplishment in each 

'□£ course wc do not mean llLcrftUy that Intellect neml ov even Bhov\ld he 
tliouglit of hm n collecFinn of units. This plirnac 1 h UKod only lo tiinke plnln 
llmL (UfforeneoB In lii(oIlccUinl ability, nnil llic rolnllnu of IIipho (llfferi'iicoH 
In collogo work In of Importnncv. Neither can wc tlPScvlliG college work In 
terms of units. It would he 11 clear caln It we could, Tlie point is that 
llie relative cdlek-iiey of slndents' work, tllffnronceH of ineiiliil nhlllty 
counted In, Is better than cunBldcmllonB of work din'erciicc of mental ability 
iieirloutod. 



FLUCTUATION IN MENTAL PUODUCTION 


210 


one of Ilia pupila is small and tends to gi-ow smallci'. That wide 
gjios of this kind exist in most students in the nvoi'ago college of 
liberal arts could probably be neatly demonstrated if time and 
money for such a rosenreh wore nvnilablc. 

WHY THE GAP EXISTS 

The size of tliia diffcronco between what a student could do and 
wlifiL he does do is n function of many factors, among which are 
undoubtedly, (a) the irrelevance of the subject inntter to the pur¬ 
poses of tlie student, (b) the successful competUion of many extra- 
curriculnv activities, (c) the inadequate manipulation of the laws 
of lennijng by the teoehor and Ibo like. 

Now the laws of learning or the laws of correct teaching operate 
as truly in the college clas-sroom na they do in the primary school 
or the eighth grade. Lack of sound pedagogy in the classrooms of 
a university can not be defended on any ground, In fact there is 
a growing realization on the part of many that skill in leaching 
as teaching must be highly prized and honored by colloge admin- 
Istratovs. 

Instruction on "How to Teach" i.s being provided for the younger 
members of scvernl university staffs already. 

DATA ON ATTENTION 

One of the necessary conditions of learning is attention of a 
high level on the part of the learners. It may bo properly nsked, 
"What are tlie attention habits of college students?" 

The following data may be interpreted as very strongly sug¬ 
gesting that one reason for the gap between what could be done 
and what is done by college students Is that the kind oi attention 
(or lack of it) given by students in th^ coUege classroom hinders 
if it does not make impossible, i-opid oi' accurate learning. If in 
this simple chart, lino A means a very low degree of attention; 
line B means the kind of listless, passive attention that one gives 
to fainiliav surroundings while riding; line G represents a rapt 
attention, such as one give.s to the r-eading of a telegram or to 
the tense crises in a foot-ball game we can see that the amount 

C 


B 


A 


of time spent in a recitation or lecture with attention of A type 
or B type is really but little more than time out. The kind of 
learning required in college work takes place rarely if ever except 
when the matter in hand is attacked with type G attention. What 
per cent of a 60-minute recitation is spent by a student giving 
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type C attentio3\? Whafc per cent type B or type A? No one 
knows, and of course the individual variations arc very wide indeed. 
A student does not know with accuracy the amount of time spent in 
the subject matter with these types of attention. Hia opinion, 
though, is probably better than a guess, On the whole ho is apt 
to report the matter with errors favorable rather than unfavorable 
for himself.’ 

The writers selected groups of college juniors for study. The 
students were on the whole among the "bettor sort." Their opin¬ 
ions concerning tlie kind of attention nctually paid in classroom 
work is reported in the following tables: 


TABLE I 

Distridution op Kinds op Attention in Per cent op Total 
Recitation Time for Cultural Courses, 

College op Lideral arts 


% 

5 

10 

16 

20 

26 

30 

36 

40 

46 

60 

66 

60 

65 

70 

76 

80 

86 

90 


A 

5 

9 

8 

11 

3 
1 
7 
2 
1 

4 
1 
1 


B 


1 

2 

1 

4 

12 

2 

9 

4 

5 
4 
3 
1 


G 

5 

10 

12 

9 

C 

5 

3 

1 


A, B, and C refer to kind of attention as defined in context; '^o 
refers to % of average recitation. To be read five students thought 
6 % of the recitation time involved type A attention; nine students 
thought 10% of the time involved type A attention, etc. 

These distributions give a spread of the type of attention, juniors 
give in the average recitation. The central tendencies are: (1) 
that high, effective attention, type C, is given 16%-20% of the 
time; (2) that a lower, less acute attention is given B6%-60% of 
the time; (3) that between lB%-20% of the time practically no 

Ui’or data on the unconecloiiH tencloncy of ovcr-oBtlrantlon see: Pllfnlla 
ttnu Untln^ Schemes, ICnlght.Frnnzon (Joiirnnl of Ediicnllonnl Ucsctirch, 
May. lt»22.| 
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attention is given nt all. Little Iciirning can go on when atten¬ 
tion of typo A or B is given. Obviously a central improvement in 
college instruction would be to make those changes in class pro¬ 
cedure which would tend to cause a large percentage of recita¬ 
tion time to involve that type of attention which is essential to the 
learning process. 

When we have a group of students in the college of commerce 
estimate the percentage of time in the recitation given to the three 
types of attention, we get a slightly different result. The central 
tendency of the Joweat kind of attention drops 5%. The middle 
60-60 type of attention takes up about B0% of the time. The ef¬ 
fective type of attention ia the rule about 26% of the time, slightly 
higher than in orothodox cultural courses. These data are spread 
in Table 11. 


TABLE II* 



College 

OP Commerce 


% 

A 

B 

C 

6 

g 



10 

3 


3 

15 

3 

3 

2 

20 

ai 

1 

1 

26 

2 

2 

9 

30 



4 

35 


1 

1 

40 

1 

1 

2 

46 


1 


60 


10 

2 

66 


2 


60 


3 

1 

65 


1 

2 

70 


2 

1 

80 




85 




90 




96 





When, however, we go over into the definitely vocational courses 
of law, medicine, and engineering, the opinion of the students as 
to the kind of attention paid in class is in startling variance with 
comparable opinion of students in the college of liberal arts. Data 
on 60 law students is spread on Table III. 


^Koncl tlia snmo ns TnUIc I. 
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% 

6 

10 

IB 

20 

2B 

30 

35 

40 

46 

BO 

55 

GO 

05 

70 

75 

80 

86 

90 

95 


TABLE in 
I.iVW COIiLEOF. 
ABC 
21 15 

14 8 

G G 

4 a 

1 3 

0 2 

1 0 1 

1 0 

0 1 

0 2 

2 0 

2 

3 

4 
B 

15 

3 

1 


Summary oC these data: The drlfb tawnrd effective attention 
habits is significantly paralleled by drift in curriciiln toward voca¬ 
tional content, This weans, in the opinion of the writers, nothing 
more or less than conscious motivation causes large fluctuations 
in mental production. 


A SECOND INVESTIGATION 
The above data arc worthy of consideration despite the absence 
of objective measures of mental production. We now will de¬ 
scribe an experiment in which ndcquntc objective data further 
support our contention. 

THE SCHJKCTS Oli* THK KXl'ERIMKNT 
The subjects of this experiment were ten college freshmen wlio 
had been subjected to a strenuous regime of humiliation and 
fatigue duty during their probation pei'iod as pledges of a fra¬ 
ternity.' A brief summary of this regimen is in order here. 

The first day of probation each one of the ten subjects was 
given a rather strong dose of physic (two Hin'kle's pills). They 
were not permitted to shave or bathe during the entire period of 
probation. A fake branding, very realisUeally carried through, 
which, according to the testimony of the chairman of the initiation 
committee was obviously a considerable mental shock, was a part 
of the program. Each freshman had to carry with him wherever 
'he went some rather weighty or bulky article as n brick, a pail, 
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0 piece of gas-i)ipc, ale* Besides these quantitatively rathei- uii- 
measurnblo indignities, which fiirlher includod generous doses of 
“paddling" with barrel-staves, the eating of raw liver (ostensibly 
dog-meat) .sprinkled with nsafocUcla; the application of embar¬ 
rassing, rather huniiJiuting names to the pledges, etc., perhaps the 
more sign/fiennt featui*es from the point of view of this experi¬ 
ment arc that the men wei-e iicrmitted to sleep only from one to 
two hours out of every twenty-four, nnd that during each of 
their twenty-two waking hours they were compelled to do menial 
or nonsensical ta.sics about the hoti.so, or more frequently to go for 
long hikes of 12 to 15 milc.s, In addition to all this, they were 
i-equircd to attend to their regular university work, 

The probation period begun on Monday, and the experiment to 
be described here wns curried out on the following Friday late at 
night. Here we have a group of tvorkers, fatigued, harassed, and 
working at a time when the social customs of a coUege campus 
make work unusually distasteful. Eagerness for entrance to 
the fraternity was ostensibly related to scores made during- 
this work period. Tims L>ie cards were stacked against this group 
exedpt for motivation. 

A few days latei- a group of 54 college juniors (mostly women) 
were given a similar but shorter tost on the same material aa a 
means of securing conipurnblc data from "normal" individuals. 

Comparison of scores made on intelligence tests showed no signi¬ 
ficant differences between the two groups. The juniors were 
worlcing under good conditions but with no special motivation. 
Thus tlic cards were slacked in their favor for no motivation 
other than those operating in a normal college recitation, 
yiATlilllAT, AKD PnoCiiDUJlK OV THE nWESTIGATION 

The materials used wore the Thorndike addition sheets, each of 
which has forty-eight columns of ten addends -with I’s and O's 
omitted. "Any Eueces.*5ive five of the columns are of a difliculty 
nearly, if not exactly equal.’" These .sheets were arranged in pads. 
There was no possibility of the subject’s x-ememheriiig tlie answers, 
for there was no possibility of identifying tlie seven different 
kinds of sheets. 

Our handicapped but motivated grouiJ was told by a member 
of the fraternity that they were to assist in a .scientific experi¬ 
ment and that they were to push themselves to the limit ns scores 
on the tests were involved in llnal election. Desire to qualify for 
the fraterniLy was the motivation. The attitude of the group ns 
a whole was one of cordial co-operation. At the signal "Go!" 
they were to begin adding and to continue until a signal "Mark!" 
was given. This was done at the end of every five minute period. 

'Spo Giirlli, T.It.. Mcntul IWUirMf. Ai-e?ilvc'S of Psj-eJj. No. 41, Aiiffiist, 1933. 
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Twenty-four such fivc-mrnutG wrk periods were given with a ten- 
minute intermission fit the end of the first twelve periods, at 
which time the subjects wore given light refreshments, The 
"Mark” signal was for the purpose of getting nn introspective 
check on the feeling-tone of the aubjccta ns well ns to measuic 
progress by units of time. They were told to mark A, B, C, D, E, 
or F, where A signified a feeling of general well-being, no nega¬ 
tive feeling-tone or discomfort; E was to be given the significance 
of intense aversion or high negative feeling-lone; C was to mean 
a rather neutral, clon’t-care-onc-way-or-nnother ntlitucle. Durng 
the last three periods a strong effort was made to obtain an end 
spurt by urging the men to put all they had in them into the work, 

AVERAGE AND INDIVIDUAL SCORES OF THE TEN TIRED 
FRESHMEN ADEQUATELY MOTIVATED 

The raw data give a composite work curve that is very nearly 
a straight line (See Figure 1) for both the total amount done and 
the amount correct. Nor is there any noteworthy falling off in 
nccuracy, The data from which this curve is constructed are 
shown in Table 1.® The last five-minute period docs show a 
smaller per cent coi’recb than do any of the other periods, but the 
difference is slight. The curve of the percentage correct is shown 
in Figure 1 at the top. The straight horizontal lino through the 
curve representa the arithmetic mean of the percentile values for 
each five-minute period. Whatever decrease in total omount or 
amount correct occurred may be shown by comparing the work of 
the first 12 periods with that of the last 12. Table 11 gives the 
data for each person so compared na well ns the totals for the 
entire 24 periods, The percentage of correct work for the first 
12 periods is 86, that for the last 12, 83—a decrease of hut two 
per cent! 

The individual work curves arc shown in Fig. 2. Perhaps their 
most striking feature is the consistent dorynward trend in the 
curve of satisfyingness and the lack of a significant corresponding 
dowmvai'd trend in the output. The curve of satisfyingness®—in 
the case of every individual except Fitz—shows a marked de¬ 
cline with the progress of the experiment. In hia case the inter¬ 
mission for refreshments proved to be annoying rather than sat¬ 
isfying. 

‘As nppenVB from tlio Individual work curve 2) subject 1!—cnine 

four purloila Into. In order to cnlculntc nvernges tor the avIioIq ffi'onp, Ills 
total output was wGlglited with lila nvccage production puv flvc-JiUnutc 
porloda for the hventy porloda that he nclunlly worked, This procedure 
wonlrt Bocm lo bo Inlr. 'j?lie ^ncral concliiijlons arc not In iiiiy case dlf- 
Icrent Umn they would huve beca vrtciioul Bueh wclBbtlng 
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TABLE I 

Showing the nniount ot work, tho nmoiint corrocL, Lhc {iinoiml, 
incorrect, ond Llie per cent correct for the ten frcsshmcii in terms 
of columns fielded per five-minuLe period. 


Per cent 

Period Total Ain’t, Total Correct Total Incorrect Correct 


1 

223 

188 

86 

84 

2 

237 

2QG 

31 

87 

3 

188 

158 

30 

84 

4 

20G 

170 

30 

8 C 

B 

217 

179 

38 

82 

G 

219 

194 

25 

89 

7 

218 

183 

35 

84 

8 

208 

175 

3.3 

84 

9 

223 

183 

40 

82 

10 

216 

181 

35 

84 

U 

180 

IGO 

26 

80 

12 

212 

17G 

30 

83 

13 

227 

ISO 

3fi 

83 

14 

240 

197 

43 

82 

15 

215 

188 

27 

87 

IG 

194 

162 

32 

84 

17 

205 

172 

33 

84 

18 

204 

184 

20 

90 

19 

207 

179 

28 

82 

20 

188 

162 

20 

86 

21 

191 

155 

30 

81 

22 

198 

157 

41 

80 

23 

200 

169 

31 

SB 

24 

203 

167 

46 

77 

Av, per person 21.9 

17.8 

4,1 

Av, 84 
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TABLE II 

Sho\vinff daLa for 10 individuals in terms of number of columns 
added. 


U O 



u 

o 

<J 

u 

4) tj 

B 


B 

a 

s? 

Marks Indicating 
Fcoling-tono 

d 

O d 
u 

qS 

■sw 

-sa 

3® 


n 


D 

ID 


p ® 

o 

1. 

01 0 

M 

O if 



©>3 

A 

0 

F 


H 

fiiO 


h,3 









Pitz 636 

440 

82.09 

257 

205 

279 

235 

23 

1 





Po 490 

429 

87.6D 

247 

216 

243 

213 

6 

8 

3 

4 

3 

1 

Gi 666 

603 

88.86 

329 

292 

237 

211 

7 

6 

4 

2 

3 

3 

Bar B3G 

459 

86,63 

277 

233 

269 

226 

9 

3 

B 

7 



Bai 362 

27G 

78.41 

182 

186 

170 

141 

13 

6 

3 

2 

1 


An B81 

478 

82.27 

282 

237 

299 

241 

13 

3 

2 

3 

3 


Gr 618 

460 

89.90 

264 

236 

254 

230 

7 

6 

11 

1 



Ne 705 

671 

80.99 

368 

300 

347 

271 

4 

14 

6 




Bo 312 

229 

73.40 

150 

128 

162 

301 

2 

2 

6 

3 


8 

DeS464 

417 

89.87 

220 

200 

244 

217 

1 

6 

7 

2 

0 

3 

Av. 600,0 

420.8 

84. 

25G.6 

218.2 

249.4 

208.B 70 

61 

40 24 

16 

16 


The curves show no wide diver^cncca of amount correct from 
total amount done—they praetically parallel each other from one 
five-minute period to the next throughout the experiment. 

The features of the work curve contended for by Kraepelin and 
his followers are not in evidence—^at least not consistently for all 
the individuals. There is little if any more fluctuation upward at 
the beginnings or at the end to indicate “Anlauf” or “Schlussan- 
tricb” than chnnce would account for. Subject."? Pits —, Fo—, 
Dea —, Bai—, An— and Gr— show an increase both in amount 
done and amount correct from the first to the second period. Bo—, 
No— and Hav— on the other hand show a decrease, while Gi— 
does not change in total amount done. The terminal spurt is no 
more in evidence, notwithstanding an effort to produce one by en¬ 
couraging and urging the men to increase their speed if possible, 
The amount done shows an upwai'd trend for Fits—, Gi—pDe^—; 
Ne—, Hav— , Bui—, Gr— and Bo— however, exhibit a down¬ 
ward curve. Nor did the intermission cause any uniform change 
in output. 

Pig. 3 shows graphicolly in another way the relation between 
output and feeling tone. The curves were constructed by dividing 
the total number of A's, B’s, C’$ and so forth, into the number 

*The raiigo of feeling Lone Indlcalcd by caeli aubjcct 1 b plotteil nt the 
right of tile grapu, an Intllcaicti by tbe Icltcre A, 1), C, I), P. 
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of columna marked by each, and plotting these results against the 
letters on tlie abscissae. If feeling-tone correlated with output 
there should then be a consistent more or le.ss parallel downward 
trend for the two curves. Some of the curves—those for Do—, 
DeS—, Hnv—, Gr—, and Ne—, do show somewhat of a downward 
trend. Fo— and Bni— show practically no change; Gi—, however, 
increased markedly in output when his feeling-tone was most neg¬ 
ative; this is also true to a somewhat leas extent for An—. 

SUMMAHY 

The experiment was carried on for 24 five-minute periods— 
that is, two working hours. The ten subjects had n total output 
of B060 columns added, of which 42G8 or approximately 84 per 
cent were correct, The average total omoiini added was approx¬ 
imately 21 columns per five-minute period per person; the aver¬ 
age amount correct per five-minute period per person was ap¬ 
proximately 18 columns. The range of individual achievement is 
from 40 columns attempted with 3C columns correct for subject 
Nel—, to ten attempts and two columns correct for subject Bo—, 

CONCLUSIONS’ 

1. A two-hour work period, with this kind of material for in¬ 
dividuals who are already physically tired, is not sufTicient to 
decrease the output to any appreciable extent. 

2. There is little or no apparent relation between feeling-tone 
and amount of work done. 

3. There is no evidence of n wnrming-up period or of initial 
spurt. 

4. Accuracy is little affected, 

6. In spite of an effort to obtain an end spurt, none was ob¬ 
tained. 

DATA OF FIFTY-POUR TlESTED JUNIORS WITH ONLY 
CLASS-ROOM MOTIVATION 

The essential facts for this group are shown in Table III. The 
material used for the group was exactly like that used for the ten 
freshmen. Fig. 4 shows graphically the work curves for the group, 
both na to total amount and amount cori-ecfc for each five-minute 
work period. There is little that is noteworthy concerning these 
data except the very greatly reduced output as compared with the 
freshmen. Possibly this is to bo accounted for on the basis of 
class-room 'set' rather than on the ground of less ability in adding, 
There is nothing to warrant the assumption that the fre.shmen as 
a group were more skillful at this sorb of thing by reason of 
previous troining. The differential of motivation and mental at¬ 
titudes is the explanation of the differences of an average of 21 

’Tlifise (Intii Blvo liiBlglit Into certain aspects ot '‘Moiitol Fiitlpuc." Wo 
are uhIub tliom only to hIiow iimoiintB of work ns rcliitcd to luotlvatlou, 
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columiia per five-minuto poriod for the frcahmcn as against an 
QverngG of 11 for the juniors.® 

The percentage correct for the juniors ia in general the san\e as 
for the frcshffiGn. It will be observed, however, that the decrease 
in nraount correct ia approximately the same for the jnniora na 
for the freshmen. There is no reason to believe that this decrease 
is due to fatigue; the tc.it was given at 8:00 a, m., tlic firat hour 
of the ncadomic day. 


TABLE III 

Data obtained from 64 college juniors in terms of number of 
columns added; 


n 
wa 
o o 

oS 


a 

i3 

4 O 

EH^ 


o 

21: 
4 g 

W 


do 

«• u 

U(u 

k k 
4Q 


B-4 
iJ O 

S a 

S k k k 
S 01 U 

OfU 


B 

^ H 
O 

n w 

sj k 
" 41 


5 

“H p p 

.j K 

°sl£ 

S ' to 

L, ti h 


'^k 

V4 U 

OPh 


Isfc 6 min. 

998 

872 

87 

IS 

4.18 

16 

4.67 

2d 6 min. 

843 

720 

61 

1C 

4.90 

13 

5,25 

3rd 6 min. 

002 

765 

65 

17 

6.46 

14 

6.14 

4th 6 min. 

868 

726 

82 

16 

4.92 

13 

B.06 

6th 6 min. 

836 

GDO 

83 

16 

4.96 

13 

6.20 

6th 6 min, 

867 

710 

83 

10 

4.71 

13 

4.9G 

7th 6 min. 

876 

720 

81 

16 

6.00 

13 

B.63 

Av. 

6178 

5128 

83.125 

16.3 


13.6 



CONCLUSION 

The above data auppovt tho following assertion; The differenco 
between a gemiinc motivation such aa the freshmen had, and the 
kind of motivation n college class contains, ia a difTerence which 
not only offsets extreme fatigue, but further offsets freshman va. 
junior ability, and in addition produces twice as much work per 
Unit of time with equal nccurncy, 

juiilora were Just a» orillnory icnchlnji groui), a typlenl lotiriilDB' 
Biluallon. 



INFLUENCE OF MENTAL LEVEL IN THE 
FORMATION OF BOYS' GANGS' 


By M. LaVinia Wahneh, 
Ohio University 


It has been noticed that certain boya group together; that a 
boy will have certain friends and not seem to have any other very 
close friends. There may be several circles of friends among the 
boys in a community and the circles -will not intersect. 

This seems to indicate that there is a fundamental cause why 
certain groups of boys are found together and that it is not clinnce 
but some underlying law that groups boys. The boys are brought 
together by churches, schools, and the like, but the churches and 
the schools do not classify them into the different groups and gangs. 
Hence the question arises: Why are certain boys found in one 
gang and not found in some other gang? 

Dr. Charles B. Davenport in speaking of the mating of the 
feeble-minded says, “The meager social life, the customs of their 
parents, the natural ostracisms of the higher classes, and the in¬ 
dividual’s preference for a congenial mate induces in marriage 
among the mentally deficient.” (2)’ He found that the more fre¬ 
quent results of immigration of a feebleminded is his marriage 
into another defective strain in another part of the country. Altho 
in different localities, their social standards have been practically 
the same, for social standards are determined by mentalities as 
well as by experience, education and wealth. Consequently their 
social standards have been influenced mostly by mental level and 
inmarriagea of the defective strains have resulted. "The social 
laws and natural preference of the individual is so powerful that 
like -will consort wth like even in outmarriage." (2) 

Dr. Davenport says, “The law that like tends to marry like in¬ 
terferes mth the beneficient tendency (that the introduction of 
new blood would lead to better progeny) of outmating. The con¬ 
sorts selected from outside are frequently quite as defective as 
those who select them.” (3) 

Miss Mina A. Sessions gives the same ideas of marriage selec¬ 
tion fts those given by Dr. Davenport. Miss Sessions says, “The 
reason for so many cousin marriages are probably twofold. First 
in their own stock they find the most congenial companions, and 
second, they are largely forced to marry each other for the simple 
reason that no one else will marry them or have anything to do 

‘Thin firtlclc l8 n condeiiacrt form. ConiDlote article may be foiincl nt 
Ciirin>BlB Lllu'iiry, Ohio UnivorHlLy, Atiioiia, Ohio, and In Coluinblii llnlvor- 
sUy Llti-pry, Neiv York City- 

“Numhers throughout this tliCHls refer to Ulhliograpliy listed nt the end. 
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with them, ‘WhcTi they do marry outside the family, they marry 
some member of a weak strnin.” (10) These invostiRntions lead 
ua to believe that "Birds of a feather flock together," even in mar¬ 
riages of the fooblG-minded. 

The same idea holds true in marriages of tlio deaf. Dr. Pay 
says, "In no human relation is the truth of tlic proverbs, 'Birds of 
n feather /lock together’ and 'A fellow-feeling makes one wonder- 
ous wise!' more fully exemplified than in the friendships and mar¬ 
riages of the deaf," 

In his study of the divorces of the deaf, Dr. ITay found the pro¬ 
portion where both partners were deaf to he 2.5 per cent and where 
one was deaf the other heating, the proportion reported is C.4 per 
cent, Tliis shows that the matings were more .successful where 
both partners were deaf than in cases where one was n hearing 
person. The deaf partners rvore more congenial than one of them 
could have been if he were connected by hearing and speaking with 
those around him- (5) 

The deaf hove a common mode of expression. This enables 
them to appreciate and enjoy one another. Each is more or less 
barred from the hearing folk and he is glad to have a companion 
similar to himself. Their deafness causes them to have common 
experiences. It is the effect of their deafness that attracts and 
holds them in companionship. 

Dr. Davenport and Miss Sessions determined for the feeble¬ 
minded and Dr. Fay determined for the deaf, that there are com¬ 
mon factors at work in bringing and holding together each of 
these respective types of people, This suggests that the sams 
principle could be applied to other types, 

In order to males q study of the factors determining boys’ gangs, 
various groups of boys who have been brought into court and who 
were known to be close companions by court officials, social work¬ 
ers and school officers, have been investigated, The data was de¬ 
rived from school reports, court records, and the records filed by 
the Children's Service Bureau, Youngstown, Ohio. The social his¬ 
tories are the reports of investigations nfitnde by the bureau’s special 
social workers. The pyschological examinations were made by Dr. 
H. H. Young, director of the Children’s Service Bureau and hia 
assistants in psycliology. 

Thirteen groups and seven pairs of boys were tabulated and 
sixty-six different individuals were included in the study. 

The ages in each group were computed to the date of crime com¬ 
mitted by that group, or if no particular date could be obtained, a 
given date was taken. So in each group both the chronological 
and the mental ages of each child are given for the same date as 
that of his companion. 
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REPRESENTATIVE CLUBS AND GROUPS 

THE FRANKLIN CLUB 

A group of lioys traveling about the city doing many little things 
that were not to be favored, attracted the attention of court of¬ 
ficers and social workers. Those boys were well'equipped for vari¬ 
ous sorts of business that require no arrangements with the other 
party concerned. 

The gang had three horses and an old wagon. They drove 
about the city picking up bottles, rubber and the like and "stealing 
oranges, bananas, whips, pop, beer, whiskey, cigarettes, copper," 
etc. 

When about nine years old, A. S. one member of the gang, told 
of cutting the windows at a gun shop and how they were cliased 
by a policeman, He said that they were caught twice and that 
when caught they gave wi'ong names. He said that they generally 
drove tho best horse so that they could make a better get-away. 
They got up at two or three o’clock in the morning and "went out 
picking,” returning about five o'clock. 

A- S. gave many instances which show that they are a real gang. 
Their environment lends them to do anti-social things and with 
their low mentalities, they do not always make a successful get¬ 
away, In all probability they are caught many more times than 
they would be if they were of higher mentalities. 

Their main work seems to have been stealing automobile parts 
from one party and selling them to another. In one case they 
would take the materials back and sell them to the "Jew’’ from 
whom they had stolen them. 

The gang was first noticed in particular when they broke into 
n jewelry store window in order to steal some nickels that were on 
display in the window. The boys got the idea of cutting tho glass 
from a picture show, The actor cut the glass with a glass cutter, 
then tapped it lightly until a smooth piece fell out, The boys had 
gotten some gloss cutters from a twenty-five cent store the day be¬ 
fore. They had stolen some of the cutters and had bought some. 
They were not as successful as the actor on the screen, however, 
in cutting the glass. A policeman came along, arrested them and 
took them to the Detention Home. They were given a hearing in 
the Juvenile Court and the judge suspended sentence in each ease. 

A few days later a boys' worker formed this group of boys into 
a club, later called the Franklin Club. The boys' worker tried to 
interest them in athletics and games of various kinds. They were 
taken to the park on hikes and in every case their individual inter¬ 
ests were studied and appealed to as far as possible. 

For a period of a few weeks after these boys had been organized 
into the club, they seemed to be doing well, but they were soon 
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back to some of Iheic former habits. About a mouth after thoir 
organization, aome of them played truant and some one stole from a 
store in the community. Comparing their record of the past year 
with their behavior at this time, little improvement was found, 
After working with these boy.s and not getting the results which 
the boys' worker hoped to get, ho took them to the Children's 
Service Bureau for mental examinations. 

The following table shows the ago, mental age and I. Q. of each 
at the time of breaking the jewelry store window; 

TABLE I 

THE FRANKLIN CI.UD 
Chronological Age Mentnl Age 


Name 

Yecira 

Months 

Years 

Months 

I. Q. 

J. C. 

10 

0 

7 

10 

78 

J. F. 

11 

9 

7 

8 

65 

R. L. 

13 

2 

fi 

1 

G1 

F. P. 

11 

6 

7 

11 

69 

A. S. 

11 

0 

7 

2 

65 

S. V. 

13 

1 

9 

1 

09 


Table II gives the mean variation of the chronological ages to 
be eleven months and that of the mental ages to be only five 
months. 

TABLE II 

AVERAGE AND MEAN VARIATION 
Chronological Age Mental Ago 


Years 

Months 

Years 

Months 

r. Q. 

Average 11 

9 

7 

11 

68 

Mean Variation 0 

H 

0 

5 

4.16 


Table I shows that the boy with the highest I. Q. is the youngest 
chronologically and that the boy with the lowe.st I. Q. is the oldest 
chronologically. The case of S. V, who ranks a year and more 
above the others in mental age, is Kiplaiued in his record which 
shows that he is slow and easily led by othcr.s. Dr. Young states 
that S. V. is incapable of making hia own decision. He is highly 
suggestible and is largely dependent upon his immediate environ¬ 
ment and associates. His easy way and lack of will power is 
probably the cause of his being led by lower mentalities. Taking 
the group as a whole, the tables show that the mental ages hear 
a close sameness. 

There are other gangs of boys in the ixeighhorhood, but the 
Franklin boys are not found, with them. The Franklin boys at¬ 
tend regular public schools, and this chance to meet other com¬ 
panions does not seem to affect their choice, Altho they come 
in contact with the higher boys, the duration of their companion- 
ship is so short and non-social that no noticeable event lakes place. 
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No doubt, the mentally higher boya commit little crimes, but they 
bar from their company any one who is liable to expose them. 
Consequently the type o£ mind found in the Franklin club has no 
place with the higher type child, Then the lower level boy would 
not be able to contribute to the success of the gang and being a 
misfit he would go where he could be nearer the top in action and 
where he would ho on an equal with hi.q fellows. 

The public school .attendance department shows that in cases 
of truancy among the Frnnldin club, the boys were either alone 
or in company with another member of the club. However, the 
record of J. F. shows that he played truant three times with two 
other boys but their mental ages do not differ from J- P.'s more 
than six months and tlie I. Q.’s are within the range of seven units. 
Court records show that boys from this club have committed 
ten different Crimea in company with one another, but there is no 
account of any one of them being arrested in company ^vith a boy 
who rates with normal mentality. Three boys from the Franklin 
club, however, have been in court with boys from other groups 
which arc included as subjects for this theme and in each case the 
other boys rate below an I. Q. of 69 and with a mental age not dif¬ 
fering a year and seven months from that of the Franklin boys, 
and within six months on the average. 

OnOUPS NUMBERED SEVEN, EUEVEWAND THmTEEN 
Of the boys examined in grouj) seven, the one with the highest 
I. Q. is the youngest chronologically, and has the highest mental 
age. Altho the difference in mental age is greater than that in the 
Franklin club, yet the same .tendency that like mental ages tend 
to group together is found here. 

TABLE HI 
GROUP SEVEN 


Chronological Age Mental Age 


Name 

Years 

Months 

Years 

Months 

I. Q. 

C. B. 

15 

0 

10 

8 

71 

J. B. 

15 

8 

8 

6 

64 

J. A. 

16 

6 

No mental rating 


J. B. A, 

13 

3 

No mental rating 


R. C. 

16 

6 

9 

4 

60 


C. B. and J. B, are very close friends, C. B. being the follower 
and admirer of J. B. S. B. ia so low mentally that he will jump 
into any undertaking without fear of consequences and C, B. is 
low enough to follow the example. C. B. is not troublesomely in¬ 
clined and he would probably cause society less trouble if it were 
not for his close companionship with J. B. Although C. B. ia not 
so low mentally as J; B. yet because J. B. is older and larger and 
is able to do striking things, C, B. easily falls in line with all hia 
misdemeanors. 
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Dr. Young snys, "Time nnd again through tlie interview con¬ 
cerning C. B.’s past history, he referred to how much he thinhs 
about J. B. taking money. He seems to be much impressed and to 
think much about how J. B. takes money from his father. The 
repealed reference to tiiis together with the outline of what and 
how C. D. himself hna stolen and whnt induced him to steal, seems 
to indicate that he has a dominating mental complex about J, B, 
and his stealing which with hia low mentality is very largely, if 
not entirely the cause of his own stealing." 

The individual records of G. B. and J, B. are very similar. Their 
histories of theft nnd night wanderings are practically the same. 
It is not exactly an influence which J. B. has over C. B,, but it is 
a kind of unconsciousness on J. B.'s part nnd n thoughtless fol¬ 
lowing on the part of C. B. 

J. A. and R, C. have also led C. B. to steal. J, A. was not given 
a mental examination, but his school record shows him to be re¬ 
tarded more than three yoar.s and he has a long court record and 
a boys' industrial school record. His father reports that he can¬ 
not control him. 

J. B. A. had no mental rating either, but his scliool record shows 
poor attendance and the principal reports that J. B. A, is in one 
day and out for weeks, a'^d that all liis school work is a complete 
failure. He is pushed on in the grades and does not flt anywhere. 
He is three years retarded in nil hia subjects. 

The histories Of J. A. and J. B. A. nnd the mentnl ratings of 
the other boys show the group to be below normal and their mental¬ 
ities to be somewhat equal. As in the Franklin club we have no 
account of these boys chumming with mentally higher boys or 
boys of the normal type. 

J. B. and C. B. appear in Group Thirteen with A. S. a member of 
the Franklin club and with two other boys whose mentalities are 
undetermined, hut whose social standards are rated by social 
workers with those of their companions. Taking these boys as a 
group, we have a difference in mental ages of two years and six 
months and a difference in chronological ages of three years and 
five months. All are so mentally equipped that they are able to 
enjoy the same things. Each is in a group where like types are 
found. The I. Q.’s of the-se boys are below 71 and the I. Q-’s of 
their friends are below 78, 

In the study of Group Eleven, it was found that the chronolog¬ 
ical ages are in an inverse ratio to the mental ages. 
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GROUr ELRVEI^ 

ClioronoloBicul Age Mental Age 


Name 

Years 

Months 

Yenrs 

Months 

L Q. 

A. K. 

15 

1 

B 

10 

59 

S. J. 

13 

8 

9 

7 

70 

G. B. 

12 

7 

10 

8 

86 


The experience give?i the older cliildi'cn by living longer in the 
world tends to place them on an equal basis -witli the younger 
children who have higher mental ages. Consequently the experi¬ 
ence on the one side and the experience and the higher mental 
ability on the other enable the boys to enjoy one another's com¬ 
pany. The inverse ratio is found in Table I also, but it is not 
emphasized there so much. In fact, this tendency is found in nil 
the groups. 

Table V shows that with the exception of three groups and 
one pair, the I. Q. of the youngest boy is greater than the I. Q, of 
the oldest boy. 

TABLE V 


OnOUPS OP MORE THAN THREE BOYS 


Groups 

Oldest 

Youngest 

Difference 

1 

Gl 

78 

17 

2 

92 

09 

23 

Franklin 

01 

78 

17 

7 

54 

71 

17 

9 

72 

03 

21 

10 

68 

73 

15 


GROUPS OP THREE 


4 

02 

50 

6 

5 

80 

80 

0 

6 

60 

76 

17 

B 

92 

72 

20 

11 

69 

86 

26 

12 

68 

82 

24 

13 

64 

66 

11 



PAIRS 


14 

69 

72 

3 

15 

59 

66 

26 

IG 

82 

9S 

11 

17 

C2 

72 

10 

19 

62 

72 

10 

10 

106 

70 

36 

20 

63 

100 

37 



Average difference 16 
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This shows thnt older boys with mentnlitieg below normal have 
0 tendency to group with younger boys who have a mental age 
near their own and slightly higher. The higher mentalities of 
the younger toys enable them to cope with the older boyvS who have 
the experience ol living longer in the world. This illustrates how 
mental equality exists in groups formed by natural selection anti 
indicates that mental abilities tend to go togetliDv. 

GROUP CONTAINING BOYS OF NORMAL MENTAL ARILITY 

In three groups and in two pairs boys were found who rank 
with much higher intelligence than the other members of the 
groups. These conditions were explained when it wns found that 
in each case, excepting one, the boy with the I. Q. much higher 
than the others was psychopathic, and he also had bad heredity 
which would influence his choice of society or would lower liis 
standards of society, 

In one pair, the lower type boy was twelve years and one month 
old and mentally eight years and six months with an I, Q. of 70 
and the other was twelve years and eight months old and 
mentally thirteen years and four months with an I. Q. of lOB. 
The mentally higher boy is an adopted child. Nothing is known 
of his father, The whereabouts of his mother is unknown. His 
mother left him at a Salvation Army Rescue Home wlioii he was 
two years old and never returned for him. The mother is reported 
to be a drinking and immoral woman. The foster mother says 
that the boy is very bosay and always wants others to do as he 
wishes, Hia paycKological record ahowa that “ho does not have 
the persigtance to work out a task requiring careful decision and 
forothought, Ho \a psychopathic and impulsive to the extent that 
thru the path of least rcsislanco he foils to use the inteUigenco 
which he has.'' The principal of the school where he attended 
reports that his work was extremely poor, his behavior was very 
queer and that he had "a mean disposition.” His foster parents 
appealed to the court for a disciplinary bcIiooI for the boy. They 
felt that he needed stricter discipline than they wanted to give 
him. 

The family of the mentally lower boy moved into the same house 
with these foster parents. The boys were not acquainted before 
this. The younger boy is one of those nice looking, talkative chaps 
who ia in for everything and who will undertake anything. The 
father does not live at home and the mother is unable to control 
the child. The older boy not caring to “use the intelligence which 
he has” would be glad to have anyone for a companion who would 
follow his suggestions and who would not be hampered by fear to 
do anything which might come up before the lads. The boys played 
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truant together several Limes and once they ran off to another 
city together. 

In another case the boy who was rated as average njcntal ability 
was considered by his mental examiners as one who would be 
readily Influenced by his associates; that lie would probably not 
Initiate much, but might readily become a follower. He is psycho¬ 
pathic. 

Another boy is mucli younger than the other boys in his group, 
but his mental age is about the same, lie is lacking in initiative 
nnil is somewhat psychopathic in his rcspon.sea. He is easily in- 
AuencecI and too readily submits to the wishes of others. 

The boy who is not psychopathic is considered a case of adoles¬ 
cent instability. Possibly Inter he will gro;v more stable and will 
seek other’ boys for companions. 

It would be interesting to continue the study of these boya to 
see if they still chum with the menially lower boys in a few years 
following, but it is impossible to do that in this research. 
INFLUENCE OF NATIONALITY AND PROXIMITY 

A study was made of the nationalities represented in the differ¬ 
ent groups. Youngstown's greater population, about eighty per 
cent is foreign. In most of the groups there would be as many 
nationalities represented as there were cases. It was found that 
the nationality did not enter in. If the boys were all Italians, it was 
because tiiey lived and mot in the same Italian district. 

Proximity and school eifected the meeting of most of the groups 
find pairs of boys, In a few instances the boys met in the down 
town section where they sold papers or where they loitered around 
the cheap theatres. In one case the two boys lived on opposite 
sides of the cily. They met down town several times, became vex‘y 
good friends and finally decided to steal enough money from their 
fathers to run away. In nine groups the boys of each group at¬ 
tended the same school, in ten groups the boys attended adjoining 
schools, and in one group three of the boys attended different 
schools found in the same quarter of the city and the other two 
boya in the group were the ones who lived on opposite side of the 
city. 

This division of these particular groups would not hold true so 
very long, however, because the school system often transfers the 
pupils from one school to another and sometimes n child is placed 
in a Parochial school for a term or two. In many cases the 
children living on the dividing line of two school districts may 
have a better chance of getting acquainted than children attending 
the same school. The aftei’ school hours are not so closely super¬ 
vised as the school hours and the children may have moi'e freedom 
in choosing their playmates. Even on the playground at school the 
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childi'Qn ai’G more or less held from freedom of choice by their 
school ofTiccra. Goinp to and coming from school and the free 
hours afterwards give the best opportunity for natural aclcetioa 
of compnnioiis. During tlieso Xroo hours the boys may wander 
•where they like and they may play witli whom they choose. If 
they do not like one group of boys, they may piny alone or go 
olT with one or two others who enjoy the .same things which they 
enjoy. 

VARIATIONS OF BOTH THE CHRONOLOGICAL AN THE 
MKNTAL AGES 

In Table VI we find that the moan vuriatio nof the mental age 
is less than the mean vavintion o£ the chronological age in three 
out of five of the largest groups, that is the groups containing 
more than three boys. This shows that there is a tendency for 
less variation among the mental ages than among the chronological 
ages. 

TABLE VI 

MEAN VATUATION AND RATIO OF MEAN 
VARIATION TO AVERAGE 
Mean Variation M. V. Average 



Chronological 

Mental 

Chronological Mental 

Group 

Age 

Age 

Age 

Age 

1 

13 months 

7 months .09 

.07 

2 

3 

15 

.02 

.13 

Franklin 

11 

5 

.08 

.05 

9 

17 

9 

.12 

.08 

10 

16 

17 

.10 

.14 


Since the intelligence ciuotienta are below 100, tlie mental nges 
are less than the chronological ages and are expected to be nearer 
together. In order to determine further that mental age has more 
■weight than chronological age in the formation of groups of boys, 
the ratio of the mean variation, to the average (coefficient of varia¬ 
tion) in both the chronological and the mental ages was com¬ 
puted in the larger groups and a comparison was made of their 
variability. It was found that the mental ages were less variable 
than the chronological ages in all the groups excepting in Group 
Two and Group Ten. See Table VI, In these two groups the 
chronological ages were slightly less variable than the mental ages. 

The average of the mean variation of all the groups and pairs 
was found to be 10 months for the chronological ages and 11 
months for the mental ages. This includes the groups "whose mean 
variation was higher for the mental age than for the chronological 
age and the pairs whose mean variations were not thought neces¬ 
sary to compute before because of the small number of boys in¬ 
cluded in each. The mean variation for the whole population (60) 
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ws found to bu 18 moiithb lov tho chronologicnl age nnd 16'months 
for the mental iige. Thus we find: 

Chronological -Age; Mental Age 


Average M. V. of Group 10 ,0S 11 

--=r -= .00 

M. V. of populaLuni 18 IG 

In some groups, the chronologicnl ages arc qiiite similar, This 
is very marked in Grouj) Two. In this group, iill of the chronolog¬ 
ical ages ai'i! in the twclfUi year. The mean variation of the 
inonLal :ige,s is grenLor than the chronological ago.s of Group,s 
four, Seven, Ten and Twelve. 

In Group Seven, the chi'onological ages are very similar and the 
mean variation of the mental ages is greater as near as could be 
discovered. Two memher.s of this group have no mental rating so 
tlic niciin variation of the menial ages could not be rtetorminod in 
exact temns foi' all the inembors in the group. 

The chronological ag-cs of the trvo boys in Group Eight are 
iicavev logeLher than their mental ages. The chronological ages of 
the otlior lioys iu this group could not be found and they were 
not given i\ menial teat, so Ihoy might alter this group in either 
(lireeCion. There is very little difference in the chronological ages 
in the boy,s of Pair Fourteen and in Pair Nineteen, also. 

Thus shows that chronological ages might have some weight in 
the grouping of hoys, but since there are more groups in which 
the moan variation of the mental ages is less than the mean varia¬ 
tion of the olironologicaJ ages, we might conclude that there is a 
tendency for the mental ages to have more weight i?i the formation 
of boy's groups than chronological age. 

DISCUSSION 

In the Franklin Club the mean variation of tlTe chronological 
ages i,s twice as great as that of the mental ages. In this group, 
mental age must have affected the grouping. Common experience 
entoi’s into the grouping also. If one of the boys had lived until 
this time in a rural district he would not have enough experiences 
common to the other,s to fully appreciate the attitudes of the other 
boys altho their mental abilities are practically the same as his. 

Proximity influenced the grouping in most of the cases, It even 
had an in/luonce in the case of the boys living on opposite sides of 
the city. It wa.s u common experience which brought them togethej' 
and it vva.s their nieiital ages kept them together. If one of the 
boys bud been mentally high and the other menially low, their 
common experience of selling papers down town would -scarcely 
have been noted. Common experience i.s the means of bringing the 
boys together and mental level is the determining factor which 
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continues to mnke Lhoir experiences common- 

Experience, education, and social status liclp determine the 
choice of comrades among adults of the same level and their social 
standards nmy differ so that their tendencies miglifc be in an 
almost opposite direction, but among‘children the selections are 
less controlled. Children have more freedom in choo.sing Lheir 
companions because they have not lived long enough to be in¬ 
fluenced in making Lheir choice. Social standards, experience and 
education have not afTcctcd them to so great an extent, 

The boys in these twenty groups wore not known to associate 
with boys who rank os normal, altho Uiey had the same opportun¬ 
ity to get the same experience. Physically, their experiences were 
common, or could have been, hut mentally each type of mind in¬ 
terpreted the experience to suit its own level. 

In several groups, the oldest boy has the lowest I. Q. and the 
youngest boy has the highest I. Q.; that is, the I. Q. varies in¬ 
versely with the chronological age. This brings the mental ages 
to an equalized level. 

Boys of the same mental level can understand and appreciate 
the same things. They have reached the same degree of progress 
in the stage of mental development. Their minds are so equipped 
that they can appreciate the same sitoationa, Consequently, each 
is at home with the other. No one is comfortable for a very long., 
time if he is much inferior to those about him. He must hove a 
feeling of his own importance; that he has a place of his own 
in their society, oi* ho will begin to shrink mentally away from 
them. On the other hand, if he can play his part on an equal 
basis with lus companions, he will have a feeling of satisfaction 
and will be content to remain in their company. 

A hoy mentally high will not be satisfied with companions sev¬ 
eral degrees below himself. They cannot reach his ideas and he 
will grow tired of being tied down to their level, so he will stand 
.aloof or seek others for cornpanionships, except in some cases 
where he takes a paternalistic attitude, and assumes a sort of 
guardianship or big brother attitude. 

A special class teacher reported that her two lowest children 
who were about seven years of age, would not have anything to 
do with one another. No doubt they were too young mentally 
to be social. They were mentally below four years. The older 
and higher type of children in the class enjoyed leading these 
younger boys about and caritig for them. They had the paternal¬ 
istic attitude and the younger children enjoyed the feeling of their 
protection. We enjoy being with leaders or individuals who arc 
our superiors because we feel that we arc being benefited by their 
presence. They cause us to live in an ideal state which we enjoy. 
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The low typo child enjoys the company of the older children be¬ 
cause he likes to have them do things for him. He is taking a 
babyish attitude. 

This is not an attempt to solve the problem of group compan¬ 
ionship in 80 brief a study of so few cases, but the investigation 
indicates that mental age is the greatest factor in the selection of 
one's companion.'! and in holding groups together. It indicates 
that a common mental level with similar experiences as a back¬ 
ground is n much stronger factor in group formation than any 
other factors investigated. 
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LEGIBILITY OF BODONI, BASKERVILLE ROMAN, 
AND CHELTENHAM TYPE FACES 

By IlAnoLD E. Buutt and Oouynio Bascii 
O hio State University 

INTIIODUOTION 

The iinportniice of type IcKihility for advertiaint? or general 
reading needs no coniinent. The oiilstnnding variiihios condition¬ 
ing legibility ove size, case and face. The present study is con¬ 
cerned primarily •'.vitli the last of these and is confined to an 
intensive investigation of three common type faces. 

There ore five methods (as far ns tliu writers are aware), for 
mensuring legibility: maxiinum distnnee iiL which type can be 
read, time taken to read a passage, inimbcr of letters read in a 
tachistoscopc or minimum exposure at wliich tlioy can be rend, 
minimum illuminaiion under which type enn be seen and extent 
to which letters can bo thrown out of focus and still lie identified. 
The first two of these methods have been tlie onos most frequently 
used. The present study used the last of the five inethocl.s men¬ 
tioned. 

The most extensive study of type faces is that of Rocthlein.’ 

She presented a page of 28 letters ut a distance beyond the 
limits of legibility and tlicn advanced it toward the observer by 
20 cm. increments, recoi’dinR at each stage the letters that could 
be identified. This method made it possible to uccuiuulate a large 
amount of data in n reasonable time and n con.sidei’ablc number 
of different faces were studied. Cheltenham, however, was the 
only one which she used that was involved in the present study 
so no comparison is pos.sible. 

Roethlein found that legibility depended on form, size and 
heaviness of the letters and on the mnrgiii, position in group 
and on the shape and size of adjacent letters. 

Scott’ found that a longer time waa taken to vend a light-faced 
type than to rend a heavy-faced type. 

Adama^ performed an experiment on speed of rending a scries 
of advertisements set in a wide variety of type arrangements. 
The material was too complicated to throw much light on the 
specific problem of type face, 

The present study tried to abstract from all variablo.s except 
type fnee, Individual lettei’s were used, nil of the same .size. 

'Hiiullilt'lu, n. rv. The Urlutlrc Leuihility u/ /i/(f(’rcii< l-'tires nf 
Tyii<‘n. Auii'V. A. Ill' L’nj’c'Ii. 11)12, 2)1, l-lHI, 

-C’f. UfillluKwortli, U, L. AilrretlRind ninl .sV7fiiif/. 1020, p. 72, 

■'itcliuuK, U, I'. .lifi'orfi.sfiif/ '1(1(1 fis' .l/fi(/»(f l02l, a- 
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MATERIAL 

Three type faces were used in the experiment—Bodoni, Baskor- 
ville Roman, and Cheltenham Medium. These were used in both 
upper and lower cases. All the letters were fourteen point so 
that the size variable was constant except in so far as the upper 
case letters often occupied ereater area than the corresponding 
lower ease of the same point. The letters were cut from sample 
booklets of tlie Amcricmi Type Founders Company. 

Each letter was centered individually on white ungla 74 ed card¬ 
board GxG inches for exposure. It wa.s impossible to get a com¬ 
plete alphabet in all the faces and cases. Consequently, the re¬ 
sults considered below were based on all the letters of the alphabet 
with the exception of J, K, L, Q, U, X, Y, Z. Several of these 
letters are rather infrequently used anyway. The remaining 
eighteen letters in the three faces and two cases malce one hun¬ 
dred and eiglit letters involved in the investigation. Some other 
letter.s were included but the results not con.sidercd. 

The material was prosontecl in a Focal Variator,' Tliis ap¬ 
paratus comprises an exposure field about G inches square illumi¬ 
nated by daylight lamps inside a hood. The material exposed is 
projected through a stationary-convex lens- which contro's its size 
and then through two similai* lenses which are arrang’ed to move 
veciprocnlly so that the focal point of the image may bo changed 
without filtering the size. The material ia projected through this 
differential system xipon a stationary ground glass so tliat as the 
lenses move the image on the glass gfoes in and out of focus. The 
subject sitting with his forehead in a head-rest fifteen inches from 
the ground glass observes the images, In the present experiment 
a quarter-inch diaphragm was placed on the lens next the ground 
glass to lesson the marginal glare. This was desirable because of 
the small size of the letters used but did not affect the focus. 

The differential lens system was controlled by turning a small 
crank. This crank actuated a screw 16 threads to the inch so that 
for each revolution an indicator moved l-16th of an inch on a 
linear scale. The crank was also attached to a small wheel with 
its margin graduated into lOOths so that it was possible to make 
readings to 1-100 of 1-16 of an inch. 

The data will be presented in terms of these scale readings. 
However, it is possible to convert such readings into terms of the 
position at which the image is actually in focus. 

The apparatus was set during the experiment so that at zero 
scale reading the image was perfectly in focus on the ground glass. 
The callibration curve -was obtained by naovin gthe ground glass 
toward the lenses by increments of one inch and at each point 

••WcIhh. A- P, 2'Ae Focal I'aiinlof, Jonrniil of Kxperhnunlul i’aycliolui'y. 
11)17, '2. lOO-lW. 
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debermining the scale i*eadiiig when the linage was in perfect focus. 
These determinations were made by coming in botli directions from 
illegibility until a letter showed no appreciable increase in clear¬ 
ness and continuing until it began to decrease in clearness. These 
four scale readings were averaged. This procedure was followed 
with five typical letters at each point nnd with two observers. 
Scale readings were plotted against distance of the focal point 
from the exposure field. The curve is practically a straight lino 
whose equation by least squares is 2.09x-.64y'f 26.85=0 x repre¬ 
sents scale reading, and y represents distance of focal point from 
the exposure field. 

METHOD 

The experiment was conducted in a dark room. During on actual 
trial there was no illumination except the lights in the hood and 
a small heavily shaded light near the scale. Between trials there 
was practically no change in the illumination so that the subject 
was substantially adapted throughout'to the ground glass field, 
Prior to each trial the lenses were turned to a point previously 
determined where all the letters were invisible. A letter was then 
placed on the field at the back of the hood. At the signal "ready,” 
the observer placed his forehead on the head rest and fixated the 
center of the ground glass. The experimenter then turned the 
crank at the rate of one revolution in four seconds, keeping lime 
with a metronome. The observer named the letter ns soon as he 
recognized it. If his I'cspoJise was correct tlie experimenter re¬ 
leased the handle immediately and recorded the reading. If the 
response was incorrect, the experimenter said "No” and continued 
turning the crank until the correct response was given. The in¬ 
correct response was, of couvse, subsequently recorded. 

The letter’s were given in a random order with all the cases and 
faces inter-mixed. Each subject worked for two sittings and in 
some cases three, in order to complete the entire series. The 
subjects were frequently asked if they were fatigued and there was 
considerable opportunity for rest between trials while the ex¬ 
perimenter was recording results and changing maternal, 

The subjects were seven students taking a laboratory course in 
psychology. None of them had had experimental training other 
than that which they had received in the course. There were five 
males and two females. Five of the seven had previously per¬ 
formed a simple experiment with a Focal Variator themselves. 
The vision of all was 20-20 or corrected to that by glasses. 

RESULTS 

The outstanding differences between the three families of letters 
are shown in Table I. The first column gives the observer, the 
second the average reading of that observer for the eighteen letters 
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in Bodoni upper case. The next column, the readines for Bodoni 
lower case, and so on. For example observer number one gave an 
average scale reading for the eighteen letters in upper case Bodoni 

TABLE I 


/VVEn/lGE LEGIDILITY OF 18 LETTERS 


Observer 

Bodoni 

Baskerville 

Cheltenham 


U. C. 

L. C. 

u. c. 

L. C. 

U. C. 

L.C 

I 

14,7 

11.4 

14.0 

12.8 

17.6 

13,1 

II 

12.9 

10,9 

13.6 

12.0 

16.4 

12.9 

HI 

12.9 

10.9 

16.5 

10.9 

17,9 

13.4 

IV 

12.2' 

10.7 

13.1 

10.7 

14.4 

12.0 

V 

13,6 

11,2 

16.6 

12.6 

17,4 

13.2 

VI 

12,7 

11.3 

15.6 

12.4 

17.6 

13.6 

VII 

13.9 

11,0 

16,8 

11.9 

17.5 

13.3 

Average 

13.3 

11.1 

14.9 

11.9 

17.0 

13.1 


of 14.7 16ths of an inch. His corresponding reading for Bodoni 
lower case was 11,4. For Baskei’ville upper case 14.6 and so on. 
Thg bottom row in the table gives the average for the seven ob¬ 
servers. The same results are shown graphically in Figure 1, 

The abscissa of the curve repre-sents the three faces indicated 
while the ordinate represents the scale readings, Each observer is 
indicated by a different type of curve with the heavy curve giving 
the averages, The nine curves nearest the bottom of the chart 
indicate lower case and the others upper case. 

The general tendency of results is obvious. Cheltenham is more 
legible than Baskerville. Baskervillo in turn is more legible than 
Bodoni. The results are more marked with the upper case letters, 
It may he noted incidentally that throughout the upper case is 
more legible than the corresponding lower case. It should be 
borne in mind, however, that we are here dealing with individual 
letter.^ whereas it is well known that entire words printed in lower 
case are more legible than the same words printed in upper case. 
The results are presented from the standpoint of probable error 
in Table II, 
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TABLE II 

ItATin OF DU'KKUENCB TO PROBAULB ERROR OF DIFFERKNCE 
Ob,sower Bodoni Bodoni BnsherviUc 

Bnslcoi'villo CheUcnhnni CbcUonham 



U. C 

L. C 

U. C. 

L. C. 

U. C. 

L. C 

I 

0.2 

2.2 

4.8 

2.8 

5.8 

0.4 

II 

1.4 

2.2 

C.l 

3,9 

4.1 

1.7 

III 

5.2 

0 

8.6 

. 3.3 

1,9 

3.2 

IV 

2,3 

0.2 

4.8 

3.4 

2,8 

3.0 

V 

3.4 

2.7 

7.0 

4.1 

3.2 

1.3 

VI 

5.0 

1.3 

8.1 

3.3 

3.8 

2,3 

VII 

4,8 

1.9 

8.3 

5.8 

4.3 

2.8 

Average 

3.2 

1.5 

6.9 

3.8 

3.7 

2.2 

All cases 

7.2 

3.0 

16.9 

9.5 

8.B 

4,4 


This table jjives the ratio of difference to probable error of dif¬ 
ference for the various comparisons and subjects indicated. For 
example, with subject I the difference boLween the average of 
Bocloni upper case and the averaffe of Baskcrvillo upper ease is 
0.2 tlie probable error of difference, wliile for those two faces in 
lower case the difference is 2.2 the probable evvor. The figures 
for the seven subjects in each coUmn are averaged in tbe row 
inaricGcl ‘'average,'* The in’obablc errors were also com])iiled for 
all the letters of a given face and case for all the observers, i, e,, 
120 (18x7) readings. The differences betwoon the averages at 
the bottom of Table I may be thus evaluated and in Table II the 
row “all cases," gives the ratios of these diffcrouces to the prob¬ 
able evvova of diffcvonce. 

The tabic indicates that the diffovenee bstwQon Bocioni and 
Cheltenham upper ease is unquestionably significant, ns the 
smallest individual subject's difference is 4.8 P. E. The differ¬ 
ences between Baskervillc and Cheltenham are not as marked but 
some of the incUvlclual differences are significant ami the average 
difference undoubtedly so. The differences between Bocloni and 
Bnskerville upper case are of about the same order although not 
quite as large. With the lower ease letters the relations aro much 
the same as with the upper case but all the differences are some¬ 
what smaller from the standpoint of probable error. The differ¬ 
ence between Bodoni and Cheltenham is the most marked, that 
between Baskevville and Cheltenham somewhat less, while that 
between Bodoni and BasUci'ville lower case is of somewhat doubt¬ 
ful significance. 

These results seem plausible from analysis of the characteristics 
of the three families. Cheltenham involves relatively heavy strokes 
of fairly uniform width, Bodoni on the other hand, involves many 
light strokes and this is especially marked with upper case letters. 
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Baskerville likewise involves light strokes though not ns light as 
Bodoni. This corresponds to its interinediate position in legibility, 
In addition to the diffci'ences between the families established on 
the basis of the average of 18 letters, there may be points of inter¬ 
est in considering individual letters in the various faces. Table III 
presents data from this standpoint. Each entry in the table rep¬ 
resents the average of the seven subjects for the letter and face 
indicated. 

TABLE in. 





Bflsker- 

Baaker- 

Chelt¬ 

Chelt- 


Bodoni 

Bodoni 

ville 

ville 

enham 

enham 

Letter 

u. a 

L, C. 

U, C. 

L. C. 

U.C. 

L. C. 

A 

13;i 

9.6 

13.9 

9.9 

16.9 

12,4 

B 

12.7 

13.0 

14.1 

15.2 

IB.l 

14,9 

C 

14.1 

10.7 

15.8 

11,4 

18.3 

13.2 

D 

14.0 

12.2 

16.3 

12.6 

18.2 

14.6 

E 

12.7 

9.4 

13.1 

10,6 

16.2 

12,2 

P 

11.2 

11,6 

14.2 

12.1 

1G.4 

10.6 

G 

13.7 

10.9 

1G.6 

9.9 

18,2 

10.1 

H 

14.2 

12.6 

16.6 

13.3 

17.1 

14.7 

I 

12,8 

10.0 

12,2 

13,6 

13.1 

13.5 

M 

13,7 

13.7 

16,9 

11.9 

17.2 

16,8 

N 

11.8 

9.7 

16.9 

11.0 

17.0 

11.9 

0 

15,8 

12,6 

17.0 

12.7 

20,2 

14.5 

P 

14.4 

13.5 

14,8 

14.1 

17.8 

16.4 

R 

13.0 

11.1 

14.1 

11.5 

10.6 

10,6 

S 

13,6 

8.0 

12.9 

10.3 

15,3 

11.6 

T 

11,7 

9,1 

14,1 

9.6 

16,6 

11,0 

V 

12.2 

10.9 

14.0 

11.9 

18.1 

13.2 

W 

13.3 

ll.d 

17.1 

13,4 

17,9 

14.8 

Av. 

13.2 

11.1 

14.9 

11,9 

16.9 

13,0 


Obviously the legibility differences vary with the letters. The 
safest way to coirsider the matter is in terms of probable error. 
This was computed for any differences between means of the same 
letter in different faces that seemed of possible significance. 

The differences between lower case Bodoni and Cheltenham are 
most pronounced with the following letters and the differences are 
all greater than 4-5 the probable error: S, I, V, C, A, E, W- 
Most of these letters involve a considerable portion of light strokes 
which in the Bodoni are of course very light, With lower case 
Baskerville and Cheltenham the ratio is 7.2 for A and 4.4 for C, 
with all the others less than this. With Bodoni and Baskerville 
lower case the ratio for I is 8.9 but the next smaller is 3,7 for P. 
The most noticeable fact regarding the lower case letters is per¬ 
haps the inferiority of Bodoni or Baskerville A to Cheltonlmm A. 
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This letter has three light horizontal strokes. 

With the upper case the differences are relatively greater. For 
Bodoni vs. Cheltenham they are significant for practically all 
letters, but most marked in the case of V, N, B and 0. With 
Baskerville and Cheltenham, V, E, P, S and R, all have differences 
greater than 4.5 P, E. With Dodoni and Basitcrvillo the ratio for 
N, G and B are greater than 4.6. One noticeable thing is the 
poor showing of Bodoni N. It comprises two very light vertical 
strokes, 

Another method of approach is to consider each letter's legi¬ 
bility relative to the others of the same face and case. This 
could be .'iccomplished by ranking the values in each column of 
Table III. The greatest discrepancies between an upper case 
letter's rank in different faces are as follows; N has relatively 
low legibility in Bodoni compared with Baskerville. This fact 
has been noted above: S however ranks much higher in Bodoni 
than in Baskerville. V stands high in Cheltenham but low in the 
other two. With lower case letter.s the following discrepancies are 
large. Baskerville I is relatively high in legibility nnd Bodoni I 
relatively low. Bodoni P is relatively high and Cheltenham F, 
relatively low. Cheltenham and Bodoni M are the most legible 
In three faces while Baskeiwillc is only average. 

Jn genoval there is a somewhat closer correspondence in the 
relative legibility of the lettei’s in the three faces with lower 
case than with upper case. Correlations wore computed (rank 
differences squared) between the different columns of Table III. 
For the upper case the correlations arc: Bondonl-Baskerville .47, 
Bodoni-Cheltenham .74, Baskerville-Cheltenham .68. For the lower 
case the corresponding figures are .73, ,70, and .73, indicating 
closer correspondence in the case of the lower case letters. It 
would seem that upper cose letters afford a better opportunity 
for face differences in legibility to manifest themselves, 

A record was kept of all cases in which a letter was mistaken 
for another. These were tabulated to show any common ten¬ 
dencies. No error was considered of interest unless made by at 
least two subjects. The following confusions occurred in all three 
faces: lower case E read C; lower case H read B; upper case I 
read L; upper case R read K. The following confusions occurred 
in two faces, lower case; F rend I, T read 1; and the following in 
two faces, upper case; B read C; M read W; P read F. There 
was nothing in the analysis of results from this standpoint to 
cleaidy indicate differences in face, 

SUMMARY 

A study was made of the comparative legibility of Bodoni, Bas¬ 
kerville Roman and Cheltenham Medium type faces, The legibility 
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of individual letters was determined separately using upper aiul 
lower cose and fourteen point. The letters 'wev<i presented in 
a focal variator and evaluated in terms of the distance they could 
be thrown out of focus (maintaining constant size) and still be 
rocogniacd. 

Greatest legibility was found on the average for Chnlteiiham, 
followed by Bnslcervillc, with Bodoni the least legible, This was 
tiuc for both ‘upper case and lower cnac but the dllferenees were 
more sti’ildng from the standpoint of probable error with tlie 
upper cose. These differences seem plausible upon examination 
of the three facesi pavticulavly with refenonee to the width oi 
strobes. Study of individual letters showed a tendency for the 
greatest differences between faces to occur with letters Involving 
light strokes, inasmuch as these arc particularly light in the 
Bodoni and Basicerville. 



A COMBINATION MENTAL TEST FOR CLINICAL- 

USE 


By Grace H. Kent 

Worccslcr State Hospital, Wovceater, Mass. 

I, BIMITA'riONS OF STANDARD TE.STS, FOR DIAGNOSTIC 

PURPOSES. 


The .serviceability of mental tests for tentative classification of 
large groups of persons lm.s been established beyond reasonable 
doubt and there are many tests in common use, both individual 
and group, which arc sufficiently accurate for such purposes as 
classification of army recruits, school children, or factory em¬ 
ployees, But in the clinic no mechanically applied test should be 
expected to take the place of patient and painstaking individual 
study. Used as an instrument for such study the standard teat 
may be a valuable aid; but it i.s of questionable value if we accept 
the riiiding.s ns final and thus make it serve as n substitute for 
careful observation, 

The concept "mental age” is an exceedingly convenient one and 
it i.s not unnatural that a servant so obliging should be expected 
to work over-time, Because the mental ago can be so easily stated, 
it is almost inevitable that it.s significance should be exaggerated. 
Thus we find a tendency to speak of n child’s mental age as if it 
were as definitely and finally determinable as his life age and there 

dang-cv Ihai tho quniilntive finding's of Iho test —ivhieh inay be 
vastly move significant than any results that cun be stated in fig¬ 
ures—will bo wholly overlooked, 

An unavoidable .source of error in the use of a norm is that it is 
impossible to give clue recognition to the variations in the indi¬ 
vidual records from which the norm is constructed. The norm may 
he derived from a sufliciently large number of representative per- 
,sons, but the individual variations still remain and the limits of 
possible normality lie close to the extreme.^ rather than near tlie 
average or median,' 

'I iilviul giilllv' Id lllc J'silluri' III givu (liu> Wi'lglil (o llils liicior. In tliR 
mliTlii’i'liUlmi III' llu' ilulji wild'll loi-iiu'd lliii IiiisIm of Uii- Kcnt-Uosniiore 
iiKsocliillim U'sl, iiuliliHhoil in IIUI), 1 wiis so ilci'iilj' Iniiircssi'd hy Hie cUlTor- 
I'liui'S wlili'li Llii' losi liulii'iiU'il ln'lwi'i’U iioi'innl iiiiil Insiiiu' .suliJcctH UiiiL I 
ilIU mil I'nily ii|iiiri’cliili‘ Ilii- Iiiiiioi'Iiiiil'l' i>f llu‘ slnilliii'll li'.s riiiis luclii'iited. 
'I'l)i' an'i'iigi' Miiiiincr nf "iiHllvJiliml I'cni'llniis" I'ov Jinniiiil fUilijncLH wuS scvoii 
law coni dl' nil roia-llims, iinil ilio nvonij;o On- liismio suIiJocIh wiin twenLy- 
M'von Dor Oi'iil. 'I'lils Iw nlivluiKh- n .'•Igiiillciinl illlTci-uiici', hut wp cannot 
ilolornilno wlinl It sIi;ii1(1ok fi.r n n-ivon liidlvldnal. 'J'lio vnnjro of vai'lnLloiu 
u'iiis very wide I'or Ijolli clnHsos i-l miIiJocIs, liointr froiii zoi'n lo nlniMy imr 
I'oiii for till' noi'iniil Milijovis nnil J'l'niii live io nliioly-sovon in-r coni for llio 
iiiHiim' sul)Jo('(s, 'i’ina'o w us (Ini'- ,in owclniiitlnt.'' (iiiKMiiilltn,* (o c/fflity-llrc 
IH'V coni hciwocii Indlvidunls id' ilio I wo-ellipses, mid it Is idiiln tlint ins 
I'oiicUisloins slionid hi- dviiwn nlmiil iiny IihIIvIiIiiiiI on Ilio hiisis of ii louL 
nhleli yli'ltls snoh viidahli' rcsiilii-. 
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Anobher source of error which should be kept in mind is the 
personal equation of the examiner. This factor is well eliminated 
in many group tests by reducing the administration of the tests and 
the scoring of results to a purely mechanical process. But it ennnot 
be so Gfvsily overcome in individual tests because much depends 
upon the inflection with which the examiner vends a question, and 
upon the spirit and interest with which he presents a problem. 
The test may be so fatiguing to the-examiner that he is unable in 
the latter part of the working day to do full justice cither to the 
•test or the subject. And in spite of the scoring cards and minute 
instructions which add more to the difficulty than to the accuracy 
•of scoring, there remains considerable room for difi’ercnce of opim 
ion, especially in tests calling for involved verbal responses. 

In order to be valid for adult subjects a test should be based in 
part upon faculties that develop with increasing maturity and 
'experience as opposed to those faculties that roncli their !;enith 
during the high school period and fall into disuse after school life 
is completed. If we are to depend largely upon tests for diagnosis, 
we should have a test that would show in what way a deficient man 
having a "mental age” of nine years differs from a normal boy of 
nine. We know that the man lacks the developmental possibilities 
which constitute the boy’s chief asset to society. We know also 
that the man, by reason of his longer experience and more settled 
habits, can do many things which the boy cannot do. We indicate 
the man’s inferiority to the boy by assigning an intelligence quo¬ 
tient of fifty-six; but our criteria for determining his intellectual 
status are not adequate unless we can show also in what ways ho 
is superior to tlie boy. Determination of the mental ability which 
.is measured by the Binet scale, call it what we please, does not tell 
us what we need most to know about a clinical subject. The man of 
thirty who gives a nine-year mental rating may be a useful and 
trustworthy laborer, or he may be a serious menace to society. 
Two thirty-year men of nine-yeai* mentality, equally free from de¬ 
linquent tendencies, may differ very widely in their capacity for 
work, in their adaptability to different kinds of work, and in the 
•amount of supervision required. The fact that they give the same 
mental rating is relatively unimportant since the proper disposal 
of their coses depends upon distinctions which are not sho'wn by 
•the test. 

It is difficult to over-state the possible errors involved in the use 
of a verbal test for subjects who do not understand the language 
in which the test is given. It is true, under certain conditions, thot 
.a child’s ability to acquire language may furnish a fair index to his 
intelligence, but we cannot make this assumption in a given case 
unless we know that the subject has had adequate opportunity to 
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acquire the langnne'e. I recently tested many children in a mill 
village of -which the foreign population is in the majority. The 
children use their own language at play, even on the school grounds, 
and many of them have rarely heard a word of English outside of 
the school room. To assign a mental age based on such showing as 
they can make in a verbal test would seem little short of perjury. 
Performance tests are useful in such cases, but more for qualita¬ 
tive interpretation than for mental rating. 

A test stands on its own merits, regardless of norms, since the 
findings obtained by an unstandardized teat that is well suited to 
the subject are more significant than a mental rating derived from 
an ill-adapted test. Dr. Walter E. Fernald's questions on “Prac¬ 
tical knowledge” possess certain advantages over any standard¬ 
ized test known to me. Although they cover a wide range of 
difficulty, these questions can be asked casually and answered 
simply, usually in a very few words. They relate largely to mat¬ 
ters of local interest, and the child may easily assume that the 
examiner is seeking information on the matter inquired about. 
There is no definite programme for asking the questions, as for 
administering a move formal test, so the examiner is free to omit 
any question which does not fit the case and which might make the 
subject feel strained and unnatural. I should like to see these 
questions standardized, but not unless it could be done without de¬ 
stroying the elasticity of the system. For although a norm is a 
great convenience to the examiner, it is not essential to the serv¬ 
iceability of the teat. The age value represented by a given question 
or task is empirical, not absolute, and the examiner’s own experi¬ 
ence ought not to be wholly at a discount. When a test—even a 
standard test—is used by an experienced observer, I question the 
advantage of rigid adherence to rules. 

No test can be considered valid except on the assumption that 
the subject answers each question as well as he can. But it fre¬ 
quently happens that a subject who is brought to the clinic for 
examination comes very unwillingly and with no intention of giving 
any information about himself. The tactful examiner can usually 
obtain some measure of responaiveness, but it ia impossible to state 
the'exact degree of co-operation received. The lack of co-operation 
cannot be estimated in quantitative terms, while its effect on the 
mental rating is invariably quantitative, 

Among insane subjects one meets ■with all possible degrees of 
co-operation. Some patients put forth their maximal effort in the 
hope of proving their fitness for life in society, some offer -violent 
resistance, and some give no response at all. There are many cases 
in which the qualitative findings are of considerable interest, but 
it is exceptional to find a patient for whom the mental rating, as 
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such, htiB any significance even as a matlcr of record, still less foi- 
diagnosift or trontment. When the rating is high enough to ex¬ 
clude inentul deficiency, this diagnosis is almost certain to be 
excluded also on other grounds. A low rating may indicate defi¬ 
ciency, deterioration, or poor co-operntion. Extremely wide scat¬ 
tering of success Qiid failure is usually associated with a psychotic 
condition, but it may indicate merely that some of the problems 
presented are interesting enough to command the co-operation of 
the subject while others are beneath his notice, 

The oxaininer who administers the test usually learns something 
about the case but not necessarily anything that can be stated sta¬ 
tistically. In many cases it wonid he grossly misleading to assign 
a mental age, 

II. INHERENT WEAKNESS OF THE STANFORD 
REVISION, FOR CLINICAL USE, 

No single system of tests is equally well adapted to all classes 
of subjects, Tlie Binofc scale is especially adapted to children of 
normal mentality, and in this field I can agree with Tevmaii that 
“Ill the large majority of cn.ses persistent .silence deserve.^ to be 
scored failure." School children arc in general the most re.sponsivc 
subjects I have ever had ocension to test, not excepting psycholog- 
icaily trained university studonts, and the matter of obtaining their 
co-operation is not a serious problem. 

But this does not hold for clinical subjects, even when they are 
tested in school. The mental measurement of defectives requires 
n much Finer loclinique than is necessary for the classification of 
normal children, and at best there is serious danger of rating a 
child too low. The younger cKUdren who are brought to the school 
clinic are apt to be timid in the presence of n stranger, and the 
older ones nre usually suspicious and sensitive. Defective speech 
is very common, frequently serious enough to innko the child ahy 
and self-conscious, anti sometimes so marked that his answers are 
unintelligible. Deficient children nre very susceptible to fatigue, 
and the examination i.s usually too long, except for a child rating 
very low, to be made properly at one sitting. 

When the external conditions ai’e favorable and when there is 
no lack of time, I find the lower end of the Standfovd scale fairly 
satisfactory for testing English-speaking children who are free 
from speech defect, If a child is too young to realixc that he is 
being tested foi’ mental deficiency, it is inei’ely a question of time 
to overcome his diffidence and to gain his confidence. He regards 
the test as a school exercise, and responds to the examiner as well 
as to 0 new teacher. 

Many of the difficulties encountered in the clinical use of the 
scale ni’e clearly recognised by Tennan and cited as exceptional 
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situations which should bu met by some special mode of procodui-e.* 
But in the.clinic these diflicult situations are the rule rnther than 
the exception, and the means suggested for overcoming them nre 
usually impracticable, Under ordinary clinical conditions, as when 
the children are brought from a distance or when they are exam¬ 
ined in school by a visiting psychologist, it may be impossiblo to 
take the child out for a walk in order to establish a friendly feel¬ 
ing, to allow two sittings for an examination, or to resort to any 
of the measures prompted by common sense. A full "Out-PatCent 
Day" is not conducive to accurate work. The examination is us- 
ufilly too hurried to be satisfactory, and after four or five equally 
unsntiafactory tests performed in quick succession tlie examiner 
may he too tired to take proper interest in subsequent tests, 

My principal objection to the lower half of the scale when used 
for Juvenile subjects is that it requires conditions more perfect than 
usually obtain in the clinic—more perfect than I have ever seen 
in any clinic. But for any subject able to go above the eight-year 
level and for an adult subject of any grade of mentality, the de¬ 
fects of the scale are more serious and more fundamental. 

Perhaps tlie most delicate situation which we meet in the psy¬ 
chological clinic is that presented by the examination of a self- 
supporting young man or woman of border-zone intelligence, who 
requires supervisory care because of some problem relating to con¬ 
duct. The subject may be painfully aware of his intellectual short¬ 
comings, and the humiliation of being tested for mental deficiency 
is almost more than he can bear. If the test is to be valid, wc should 
be able to offer something sufficiently interesting to draw his atten¬ 
tion away from him.self as a subjecL-who-is-suspected-of-being- 
feeblominded. But the tasks of the Stanford scale arc strongly 
conducive to self-consciousness, especially tho questions relating to 
school life. It is little less than inhuman to require a serious 
answer to the question "What should you do if in danger of being 
late to school?” 

The vocabulary test furnishes a good illustration of a tost that 
is well adapted to school children but very poorly adapted to the 
clinic. A bright boy may regard it as a joke when his limit is 
reached, and I have never seen a normal child manifest serious 
annoyance over the series of failures with which the test is invari¬ 
ably brought to a close. But those failures are disheartening to 
the sensitive clinical subject, and the situation becomes more tense 
with each succeeding question. The test is, therefore, unduly 
fatiguing both to subject and examiner. 


-'i'll'* Monaurcniont of Iiitolllgcnce, iiagoa 12-1 to 135. 
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Ib ig not nccessa:*y to considoi- each question individually.* The 
fundamental worlciicss of the system is that too little account is 
taken of the affective reaction of the subject, Termau nasumes, as 
(lid Binet, that the questions can be presciited in such n way as to 
arouse the interest of the subject. But even if so, it is a serious 
defect of the system, for clinical purposes, that so much depends 
upon the presentation, As most of the subject matter is of no 
intrinsic interest to subnorinnl adults and ndolescents, the resources 
of the examiner are severely taxed in the effort to make the teat 
attractive enouBh to hold tVieir nttent’on. And the rules for the 
administration of the lost, when they arc followed literally, make 
the examination unduly Icngtliy and tivesoine, The examiner is 
expected to cover one year wholly within the range of the subject’s 
ability and one year wholly beyond bis range, thus including at 
least twelve questions that are frankly nondiscriminative for him, 
besides many more that are probably so, It is these nondiscrimi¬ 
native questions that are most disturbing to the subject’s emotional 
equilibrium. He is annoyed and discouraged by those that he can¬ 
not answer and frequently feels insulted by those which are so 
easy as to require no thought. 

It is of no .small importance, in the interests of accuracy, that 
a clinical test should be easily and comfortably administered. - At 
best n day's work in the clinic is usually loo exhausting to be 
done ns it ought to be done. One who is engaged in collecting 
material for a new test of his own devising may well tliink noth¬ 
ing of working eight or even ten hour.s at high tension, because 
all thought of fatigue is overshadowed by the exhileration of 
watching the returns come in. But it is very different to spend 
n whole day making routine use of that same test after it has 
been published, and still more different to spend n day making 
routine application of a test for which one- has no personal af¬ 
fection. Much of the routine testing in clinics is done by persons 
of comparatively little training, who have no vital interest in the 
results and who are not qualified to malce constructive use of 
their observations. And if their work is made unreasonably dif¬ 
ficult, it is conceivable that some of them will lighten the burden 
by taking unwarrantable liberties with the technique. 

III. SUGGESTED CRITEBIA FOR CLINICAL TESTS. 

It is much easier to point out defects in the tests we are using 
than to devise methods for correcting them. Most of my recom¬ 
mendations are negative, but it can do no harm to call attention to 
the particular needs of the clinic. 

1, The task or problem should possess sufficient intrinsic in- 

’TIkj innpliroiji’liitenuHH of llio HtnnCord llcvlHlon HiiljJeuL inntLcjr, ns iipplloil 
to adult BUbJocls, lina buon dlBCiiKNCd by Wflls mid Kelly, InlclUuoicr. aitd 
Psychcala, Ain(?i'lciin .lournnl of Inunnlly, .Iiily, lOtlO, 
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terest so that the subject will usually regard successful perform¬ 
ance as an end in itself. Spontcaneous co-operation on the part 
of the majority of subjects should be considered essential. It ia 
not to be expected that any test ■will meet with universal approval 
among clinical subjects, but there should be no tasks which are 
commonly iierformed only in response to urging. 

2, Any test used for examination of adult subjects of what¬ 
ever grade of mentality should possess sufTicient dignity so that 
it can be olYered to a mature, self-respecting man without insult¬ 
ing him. Questions should relate to politics, travel, the industrial 
world and other subjects of univei\sal interest rather than to school 
life. All material that ia essentially puerile should be rigidly ex¬ 
cluded. 

3, The requirements for each task should be simple and easily 
understood so that it may not be necessary to tax the attention 
of the subject by a long and involved explanation. Repetition 
should not be necessary and the time required for presentation 
should be negligible. 

4, Questions which call for oral response, if used at all, should 
be satisAed by very simple answers, 

6. The administration of the test should not be so exiiausting 
as to inalcG it impossible for an GKaminor in ordinary health to 
put in a full day's work of evenly good quality. Progressive de¬ 
terioration in the quality of presentation should be avoided by 
the use of tests that can be presented with the minimal amount of 
actual labor. There should be very few tests, if any, which re¬ 
quire the reading aloud of long paragraphs, and very few, per¬ 
formance tests which call for close observation of the subject's 
movements. No tests should require hair-splitting distinctions as 
to what constitutes an erroneous inovement. 

6. Time limits are necessary in order to prevent an examination 
from being Loo long and tedious. But the time allowance in most 
tests should be liberal enough so that the subject will not be con¬ 
scious of working under a time limit. Many normal persons are 
unable to do themselves full justice when working under high 
pressure, and it is unfair to class a person as deficient primarily 
on the ground that he becomes disconcerted when hurried. 

7. Tests which call for reading knowledge on the part of the 
subject have a relatively small place in the clinic, Adult subjects 
who can read a little are usually very sensitive about their in¬ 
ability to read fluently, and the exposure of the deficiency jn read¬ 
ing knowledge may be so disturbing emotionally ns to invalidate 
the rest of the examination. Also, there are many clinical sub¬ 
jects -who cannot read at all. 

8. Testa which elicit obvious failures should be avoided' as far 
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as possible. Such errors as are necessary to make a test dis¬ 
criminative should be interspersed among successful performances, 
so that the subject will not be fliscouraged by the sense of failure. 
Tests in which the subject will be wholly unaware of his errors 
are especially valuable, (Healy Pictorial Completion 11 furnishes 
proof that this is not impossible. A subject may make ten er- 
ronoous ijlaciiigs which not a minus score, iiiul yet bo perfectly 
satisfied with the result). 

9. A scale of tests intended for clinical use should be of rather 
loose construction, so that thoroughness of the examination may 
not be dependent upon any particular test or group of te.sts. The 
system of scoring should permit giving the .subject a rating on 
tests that are well suited to his command of language and his 
ability in general. It should not be necessary to give him a test 
that is hopelessly beyond him merely to prove that he cannot pass; 
nor, on the other hand, to give a lest that he will take as an insult 
to his intelligence merely to prove that be can pass. The general 
plan of standardization for performance tests in which success or 
failure is obvious to the .subject should bo such that the examiner 
may permit or assist a subject to finish a task alLcr the time limit 
is passed, so that the subject need not know of bis failure to pass 
the test. And the rules for administration should be liberal enough 
to permit the examiner to select tests in accordance with the in¬ 
terests and ability of the subject. 

Other criteria, of course, arc essential. But it is not necessary 
to enumerate here the various standards to which educational ns 
well as clinical tests are expected to conform. 

The development of a scale which shall satisfy these require¬ 
ments is a probiem inr collective rather than indiviilual effort, 
However, individual contidbutions are not wholly at a discount, 
and at worst the problem ia diiHcult enough to be intensely inter¬ 
esting. 

IV. A TENTATIVE COMBINATION SCALE 

This is offered somewhat prematurely, as a preliminary study, in 
the hope that it will encourage the splitting of composite educa¬ 
tional tests into their component parts and the publication of inde¬ 
pendent norms for the separate units. 

This plan for using a miscellaneous group of tests as a sub¬ 
stitute for a standard scale is essentially the method suggested 
by Pintner and Paterson* for deriving a mental rating from a 
group of testa that were standardized move or less independently. 

It seems to me that we can make a closer approach to the true 
mental age—if there be any such thing—by basing the estimate 
upon the median of a number of independent mental ratings than 

VI Settle i)f I’arfurniiiHcc Teals, cIiupLur VI. 
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by accepting as final the rating derived from any single system 
of tests, I believe further that it is an advantage, ofchei* things 
being ecinal, to use tests drawn from different sources, developed 
by diffeveiiL authors, and standardized by results obtained from 
dilToreni sets of children. In this way the total number of normal 
subjects contributing to the norms is greatly increased, and certain 
constant errors, such ns the personal hias of the experimenter, 
tend to be counteracted. 

It is only as a tentative measure that I am willing to accept the 
term “mental age” as the end result of the scries of tests. I con¬ 
sider the term absurd as applied to adults, and believe it to be 
frerjiiently misleading as applied to children. It is far too readily 
understood, and is therefore used loosely by persons without psy¬ 
chological training. Worst of all there is a strong tendency to 
pass it around carelessly among workers in the clinic, sometimes 
within the hearing of a subject who is capable of comprehending 
its meaning. But although I strongly disapprove the use of this 
term and greatly prefer the percentile method, I find it necessary 
to express results of difforent tests in a term that will serve as a 
common denomina'^or, and “mental age” is unfortunately tho most 
convenient term for this purpose. My present aim, therefore, is to 
collect a larg'c number of short-time tests which yield independent 
mental age ratings. 

An abbrovialod form of the Stanford scale—usually two or oc¬ 
casionally three items for each year—furnishes one unit of the 
series. Ilealy Pictorial Completion II is an exceptionally valuable 
test for Engllsh-spcakine subjects of high grade. Of the fifteen 
tests of the Pintner-Paterson performance scale, I find the fol¬ 
lowing especially useful: Mnre and Foal Picture Board, Seguin 
Form Board, Five Figure Board, Two Figure Board, Casuist Form 
Board, Triangle Test, Diagonal Test, Ship Test and Substitution 
Test. Other tests which I am using ah’cady or expect soon to add 
to my collection are as follows: Koha Block Design Test, Holley 
Vocabulary Test, Ferguson Form Boards, Cube ConstriicLion Test, 
Deai'born Form Board, Pressey Primary, Pressey Intermediate, 
Otis Intermediate, and selected tests from the Herring Revision of 
the Biiiet-Siinon Scale." 

The essential fCcature of the programme is that each task pre¬ 
sented to a subject can be selected with special reference to the 
interests and ability of this particular subject. Any test which 
does not elicit good co-operation is to be dropped, and the record, 
even if complete, is not to be counted in the series. 

‘I wish lo (‘Xpri-Hs mv KmllLuni* to Dr. J. P. Ileiriiiff, who Ims supplied 
mo wlLli rpcnicls whioli I cnii compute ngc uorin.s loi' iniy li-sts which 

I wish lo use. 
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The tests used in nny examination should be as varied ns the 
subject's ability nnd interests pei-mit, and it is important to have 
Q larger collection from which to draw, especially of verbal tests, 
If it were necessary to choose between language tests nnd perform¬ 
ance tests I should give the preference to performance tests, be¬ 
cause nearly all clinical subjects co-operate more readily in these 
testa than in tests requiring an oral response, nnd because there 
are many subjects who cannot be reached at all by language tests. 
But performance tests are limited in their scope, and many of them 
are highly susceptible to tlie influence of chance. Tliey do not take 
the place of language tests, for subjects who have fair command 
of the language and the frame-work of the method will not be 
complete until verbal test.s nre available in much greater variety. 
The verbal-performance tests which are now being used extensively 
in schools oifer a wealth of material for thivS purpose, The Ter- 
raan Group Test, for example, contains several units which would 
be exceedingly useful in the clinic, given ns individual tests. It 
will be irccessary, of course, to compute norms for the separate 
units before they can be used in this scliemo.” 

It is my plan to use in approximately equal proportions tests 
which depend upon accuracy and tests which are scored by speed. 
While it is of course iinpossible to distinguish between those two 
variables in a strict sense, I think we are justified in disregarding 
one or the other in practice, In those pei'formance tests in which 
the performance leaves no record of the errors, the difficulty of 
counting the subject’s moves introduces a source of inaccuracy 
which it is particularly desirable to eliminate, since there is no 
way of checking up the examiner's count, In the Pintner-Paterson 
tests which I am using most freely, tlie error curve runs almost 
parallel to the time curve. It is true that the time record does not 
tell the whole story, but I cannot see that the count of moves or 
errors adds anything to it, and I think the examiner's time can 
be spent more profitably taking notes for qualitative study of the 
subject’s mode of procedure. In giving the Kohs test recently to 
adult subjects of very superior ability, I observed that some toyed 
aimlessly with the blocks, thus making many useless moves; some 
worked by trial and error, moving so rapidly that I was unable 
tg cou;it the moves with even an approach to accuracy; and some 
worked very deliberately, with almost no false movements. All 
gave high scores, and the number of moves depended, apparently, 
move upon temperament than upon the ability measured by the 
test. 

“I iiiii iiuli'liU'd Lo Dr. Liicllii Coli* I’l'cMsc^v fid' rvovldluii mi‘ wUh u;;i‘ 
iioriiiH for (lie four piirLs i»C Uir L'rcHsr.v I’rliiini'y li-sf. TIiIh fiiriil.slic's four 
(‘.KCi'lloiil voi'lml-iXTronnaiU'i) Io.sIn Tor wuhjt'pts wlio tinrlcrsliiiul lOnL'llHli 
Inn ^Yln> CAiuiut I'L-jiiV 
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The mental obtained from n given subject by different 

tests usually vary quite widely, sometimes ranging from sixteen 
years to zero. This may be due in part to the influence of chance 
upon some of the meclianical performance testa. But as the rat¬ 
ings which are afTected by chance tend naturally to approach the 
extremes of the series, they do not invalidate the final result. In a 
series of fifteen tests it is not uncommon to find the middle four 
or five figures almost identical. If the ratings are fairly uniform 
I consider a aeries of ten tests sufficient, and I have occasionally 
assigned a mental age on the basis of nine tests. Ordinarily I 
prefer to make at least twelve tests. 

The mental age as finally recorded is tlie median mental rating 
of all the tests—never le.ss than nine—which are clearly discrimi¬ 
native for the subject, exclusive of any tests in which he does not 
give good co-operation and any tests which are too easy or too 
difficult to measure hi.s ability. In the Manikin tost, for instance, 
the highest possible score has a mental age value of eight years, 
If this record were counted in the series of a subject rating over 
eight years, the median would be lowered one point, and it would 
bo absurd thus to penalize a perfect record. A test so difficult as 
to yield u zero score would have exactly the same effect upon the 
median, and it would be possible in testing a subject of low grade 
mentality, to give enough too-diffieult tests to bring the median 
down to zero. A zero score does not necessarily prove the test to 
be non-discriminative, bull count the te.st too difficult to be discrim¬ 
inative when the subject works persistently up to the time limit 
without making any ap]n’eciable progress toward success, The 
examiner’.s errors in selecting the tests ought not to be counted 
again£?t the subject’s mentality, and it is clearly unfair to include 
these records. 

By beginning with a test having a wide range of discriminative 
capacity and gauging the subject’s ability by the results of tlie 
first test, it is usually possible to avoid giving non-discrimina- 
tivo test.s. For a subject of low grade mentality I usually 
begin with the Seguin form board or the Mare and Foal picture 
board. For a subject of high grade the ICohs Block Design test 
is very satisfactory for the first presentation, because of its \vide 
range of applicability and especially because of its unusual attrac¬ 
tiveness as a toy. 

SUMMARY 

An indefinite series of short-time mental tests, verbal and per¬ 
formance, is recommended for use in the clinic as a substitute for 
a fixed .scale of tests. Any short test for which an independent 
age norm is available may be used in the series, and the mental 
age is derived by taking the median rating of ten to fifteen tests 
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which ftve cicarly discriminative for the ability of the subject, 

Many composite educational tests which are not suitable for 
clinical use in their entirety contain parts that would be highly 
valuable as single units of a scries. The publication of norms for 
small hoinogoneous units, in addition to the norms regularly pub¬ 
lished, would be conducive to the wider Usefulness of tests intended 
for educational surveys. 

The following advantages of this method over the Stanford Re¬ 
vision have been observed: 

1. The method is move elastic than a ftxed scale, move adapt¬ 
able to the interests of the subject. By selecting tests that are in 
line with his interests, it is possible to obtain better co-operation, 

2. The method is adaptable also to tlie special qualifications of 
the examiner for administering tests, and the routine work of 
testing is thus made more attractive and leas fatiguing. 

3. The method is less mechanical, By allowing more room for 
common sense in dealing with a .subject, it is conducive to move 
careful observation of the patient ns an individual. 

4. By placing less responsibility upon the eKiimlncr for the ob¬ 
servance of petty rules, it reduce.? the chances that undue liber¬ 
ties will he taken with the technique of examination, 

B, If the tests are well selected, it allows less play of personal 
equation in the scoring of results. 

6, It is more economical of time. The period is spent upon 
tests that really test the ability of the subject in a given direction, 
and no considerable amount of time is wasted upon tests that are 
either too easy or too difficult to show definite findings. There is 
also an absolute saving in the time required for testing a subject 
of high grade mentality. 

7, The validity of the results is not dependent upon the sub¬ 
ject’s co-operation in every test presented or in any particular test. 
If he can be induced to co-operale in any ten tests, it docs not 
matter, for the validity of the test, how many questions be refuses 
to answer, 



FRESHMAN TESTS IN THE SMALL COLLEGE^ 


By Elsie Murray, 
Wells Colleg'e 


Ill tills Gi'fl of rapidiy expanding: collcffe populations and cliaiig- 
ing standrirda in cnbvance requivementa and curricula, the uses of 
a fi'eslimnn intelligence test nre manifold. In the smaller college 
admitting by ccvtiHcaLe only, one may desire a criterion by which 
to gauge the quality of successive entering dosses of entrants 
with and without Latin; or of students in the college in point with 
those in other institutions. The test findings are also ntilizable in 
connection with student guidance, to detect special abilities or dis¬ 
abilities, and to throw light upon cases of academic failure. There 
is, besides, the possibility of discovering a teat combination which 
may later prove of value in the selection of desirable (or the elim¬ 
ination of undesirable) candidates for admission. 

With all of these objectives more or less in view, a freshman 
group intelligence test wa.s given nt Sweet Briar College, in the 
fall of three successive years: November 20, IDIO, to ItO fresh¬ 
men (class of 1923); October'26, 1920, to IIG frcshm'‘n '1024); 
nnd 29 scnloi’s (1921); October 19, 1921, to 116 freshmen ''1023) 
and 32 seniors (1922). The blank used was the Thurstone Psy¬ 
chological Examination for College Freshmen, in its 1919 form 
in 1919, and in the 1920 form in 1920. This test, which is ar¬ 
ranged In ‘cyclc-oinnibns' form, with a single time limit, requires 
only 30 minutes, and calls for no formal oral instructions. It was 
administered simultaneously to groups of about 40 each, by in 
sLructors coached by the writer. 

Out of the various possibilities availoble in 1919, this particu¬ 
lar blank was selected for tidal, in pact because of ease of admin¬ 
istration, and economy of time and expense; largely, however, be¬ 
cause the types of problem represented {aTidlogies, information, 
matching of abstract statements, judgment on the truth or falsity 
of argiLinents, sentence completion, completion of number series, 
in the 1Q19 edition, the same with the substitution of an extra loord 
teat, and arithmetical problems for the two lash mentioned, in the 
1920 edition), had previously proved highly reliable in the writer's 
testing of college women (juniors and seniors).'' As compared with 
Army Alpha, the Thurstone combination seemed better adapted to 
call out genuine and sustained thinking ability on the part of the 


Ui'or ii!d aii<I eo-opernMon Jn tlie ffnllierlng ot rt«ln for tJils p/ipor Mianbs 
nro iliw vHVt’clttUy to PresWont JSjnUle lUcVcn, nml Dr. jMiiry llnrlcy, of 
Hwocl Ill'liir Collt’BO. 

“]•). Murniy ; I'ayvJinhuilral Teala as lJia(/noatio of Vocational ApUlutlea 
hi CdUcup Women. Joni'anl of Applipil Psyctiology, iMiircIi, 1020, pp. 
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student tested. In the long- run, we mu.sL admit, the hchL'Jjwv. com- 
l}lotio7i tost in the 19U) edition, and the arillimclic.al problems of 
the 1920, were found to constitute a serious obstacle to our use of 
this test. Not only docs the substitution of the luttet’ problems for 
the former invalidate the conii)avnlive value of test scores in suc¬ 
cessive years, but the wide variations in tlie po.s.sible solutioii.s of the 
former (of quite dill’ercnL qualitative vnluo), prevent any con¬ 
stancy in scoring from year to year. As rcBards the aritlnnotical 
problems, many sUuicnts fimling thorn to consume a dispropor¬ 
tionate nmount of time, simply oiniUcd them entirely, thus running' 
up relatively high score.s for speed (problems correct) ns com¬ 
pared with those of more conscientious iiKlivi(luaI.s. 

UAW Ul«i:i.’l’s, 'I'Ul’.ATMKN’r (IF SC'OUFS. mSTIlIMr'l'tnN. 

Of the 443 students tested, only three covered the blank (168 
problems in the 1919 edition, 182 in the 1020) within the time 
limit set. Among the seniors, no one scored higher than 152 cor¬ 
rect out of 168, or 144 out of 182 camong the fre.slimen. The tost is 
therefore approximately long and hard onough for the group con¬ 
cerned, in the time allotted. 

The pedagogical dilTicnlty of handling students of widely vai'y- 
ing mental calibre in a single section i.s a commonplace in educa¬ 
tion. In view of tin.?, the range of score.s within each freslimnn 
group is worth remark, The speed and alertness incUeatod by the 
upper scores (in pi'otioiii.s corrert find proideias corercfl) is two to 
throe times that repi’esented by the lowest seui'es (see Table I). 
The range in proportion of errors and omissions to problems cor¬ 
rect, as measured by percentar/e accurtiey, i.s also striking, though 
]gs.s cxLenclecl (56 to 9C% for 1923). 

The importance of calculating the percentage accuracy as well as 
the miiuber of problems correct was first suggested by the fact 
that certain of the problems are couched in such a form tliat mere 
guesswork may yield a considerable number of successes; secondly, 
by scrutiny of the academic recovda of individuals in whom a 
relatively good .score in speed or problems correct was observed to 
be accompanied by n relatively high proportion of errors. In 
many such cases, academic success or failure was found to bear 
a closer relation to the score in accuracy (number correct divided 
by number covered) than to the score in problems correct. E, g., 
in 1923, in more than half of the eases of striking dislocation be¬ 
tween decile rank in grades and in tests, the discrepancy is con¬ 
siderably reduced by substituting rank in accuracy for rank in 
in'oblems correct (see Table VIII), It seems not unlikely 'that 
while the latter may constitute the better measure of mental alert¬ 
ness and agility, in certain fields, the former (percentage accuracy) 
is a truer gauge of all-roiincl ability, or at least of certain character 
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trait.g-stability, persevernnce, effort, ambition, and the related 
qi7aljties, vrliich enter so Inrg-ely into the determination of academic 
success. 

Accordingly, nfter considerable experimentation with scores and 
correlation coefTiciGnts, the method was adopted of computing an 
‘adjn.5tGd score,' by subtrucLinff the sum of the errors and omic- 
siona from the number of successes. The coeflicient for these 
'adjusted scores’ and freshman grades i*fl3}gGs from +.42 to +.44 
for the different clnases, and is always higher than that for the 
speed scores (e.g., for 1924, the correlation for academic grades 
and number of problems correct is only .37B; for grades and ad¬ 
justed scores, .42). Each class was then split into ten equal sec¬ 
tions or deciles, on. the basis of this score, those in the highest 
decile given a rank of 10, tho-se in the lowest of 1, etc, Decile 
ranks were similarly determined for each student both in problems 
correct, and in accuracff (later, in faculty esihnates and in grades) 
and a copy of the whole placed on. file in the registrar's office for 
consultation by instructors and faculty advisers who desired 
further light on backward or promising students, 

This adjusted score, it is obvious, raises somewhat the standing 
of the 'slow but .sure’ individual, (over the fairness of whose 
rating in a speeded, test those unfamiliar with mental measure¬ 
ments feel such concern), aa it also lowers somewhat the rank of 
the slap-clnsh, swift but careless; and there becomes thus available 
a set of three score rankings, which furnish jointly a more satis¬ 
factory mental picture of the individual than any one taken singly. 
The usual combinations of swift and inaccurate, slow and accurate, 
swift and accurate, and slow and inaccurate, obtain. While decile 
combinations of 6-1-3, 1-9-4, etc., for speed, accuracy and adjusted 
score, are not uncommon, and the correlation coefficient for speed 
and accuracy in 1923 was only .37%, there are also noteworthy 
cases of 10-10-10 and 1-1-1 (see Table 11). 

COMPARISON WITH FRESHMEN SCORES IN OTHER COLLEGES 

The average score in problems correct for 1923 is 85.4. This 
falls a trifle below the corresponding averages quoted by Thurs- 
fcone" for Liberal Arts and Engineering freshmen—86.6 and 88.8, 
respectively. The nvei'age for 1925, using the same test form, 

'Ti. L. TliiiVHUmi'; A Oyclc-fhiniiliun InieiUuctUe Tcuh, Joiii'nul of 
lloniil IlPHoaroh, Kov. 1»21, p. SliH. Tlio ningo oC nvpnigos auuk'tl for iU 
Liljurnl AlIh collcfos nrns rniiii «!.« to 1H7; f«r 43 Jiiigliicei}ii(f ficfioolfl 
fi'oin 70 It) lll.U. 
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TABLE I 

DISTWftUTION or SCORES IN FRESHMAN Tms, 443 SUHJEC’l’S 

Fi'tsShwew Seniors 


Class 

1923 

1924 

1926 

1921 

1022 


No. Students 

110 

116 

llfi 

29 

32 


No, Problems 

108* 

182** 

lfi8* 

182** 

108* 


IIie:hcsl Score 

1G8 

IfiD 

158 

182 

108 

No. Problems 

76 Pei’cenLile 

119 

122 

126.5 



CiovorecI 

Median 

Iflfi 

107 

U3.B 

119 

138 


26 PerceiililQ 

94 

93 

08.5 




Lowest Score 

03 

60 

62 

83 

105 


H 

1G8 

IG9 

166 

176 

167 

Attempted 

Median 

102 

104 

111 

IIB 

136 


L 

53 

61 

61 

83 

07 


H 

143 

144 

132 

140 

152 

Covroefc 

75 

90 

ai..5 

102 

126 

122 


M 

83 

80 

90 

08 

lOS 


25 

71.5 

G9..0 

77 

87 

99 


L 

49 

42 

53 

5<'l 

84 


H 

96 

92 

95 

96.5 

04,3 

Pei-centngc 

75 

84 

84 

87 

88 

SB 

Accnrucy 

M 

80 

7C.5 

81 

82 

84.8 


25 

73 

71 

70 

76 

80 


L 

BG 

43 

00 

55 

02.5 


11 

118 

122 

124 

131 

13G 

Adjusted Score 

75 

78 

68 

83.5 

99 

103.5 


M 

60 

56 

67 

73 

8j,5 


2j 

45 

42 

55 

r.9 

"G 


L 

12 

—23 

30 

10 

42 



* 1919 edition of test, 
** 1920 edition of test. 
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rises to 90, a figure slightly higher than cither of Tl^ursLone’s 
averages. There is, however, a weak spot in these comparisons,— 
the SenlGiice Completion test, which occurs in the 1919 edition, and 
the scoring of which il has proved impossible to atandardize fairly. 

MEASUREMENT OP IMI'ltOVEMENT IN SUCCESSIVE ENTERING CLASSES 
In the use of the tests to mcdsurc the mcnLul calibre of succes¬ 
sive freshman classoN, tho .scoring dilliculty above mentioned again 
■ni’iscs. However, the scoring standard for sentence completion in 
1921 was apparently more .severe, operating if at all to lower the 
score for Lhc class of 19215, .since the median number of correct 
imswer.s for this type of problem remains fitationary for this 
clas.s, while the medians for all other problems rise a point or two. 

TABLE II 


REST RECORDS WORST RECORDS 

No. Adjusted No. Adjusted 

Correct Accuracy Score Correct Accuracy Score 


1923 

Score 

120 

96% 

115 

B2 

C6.6% 

12 

Docile Rk, 

10 

10 

10 

1 

1 

1 

192.1 


135 

91 

122 

56 

46 

-10 



10 

10 

10 

1 

1 

1 

1921 

(Senior) 

136 

96.6 

131 

63 

55 

10 



10 

10 

10 

1 

1 

1 

1925 


131 

95 

124 

62 

67 

30 



10 

10 

10 

1 

1 

1 

1922 

(Senior) 

152 

90.6 

136 

106 

62 

46 


A second hitch arose from the altered form of the test offered in 
1920, the arithmetical problems of ivhich proved a stumbling block 
to our students, many of whom possess a veritable 'number 
phobia.' The median seoi'e for this year drops in consequence 3 
points instead of rising, although the general academic record of 
this class is above that of 1923. A certain degree of improvement 
in 1925 as compared with 1923 ia, however, clearly discernible 
(see Table I and IV); median and lower limits are both higher, 
though no individual in 1926 attains as high a score as th'O best in 
1923. 

In Tables HI and IV, the relation of senior and freshman 
groups is presented. Since the best senior scores barely exceed 
the beat freshman, the claim of the intelligence teat to measure 
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native endowment rather than acquired ability or knowledge would 
seem to be substantiated.' Only the inforinaUcn and analogy 
scores of the seniors ascend disproportionately; the latter perhaps 
because of familiority with similar tests gained in Psychology I. 
The bulk of each senior class ranks in the highest qunrtile of the 
freshman class subjected to the same edition of the test, This is, 
of course, as it should he, through the natural process of selection 
and elimination of the weaker operating over three college years. 
There remain, to be sure, in the senior classes n number of strag¬ 
glers in the lower quartiles whose academic status is for the most 
pnrt as unsatisfactory as their intelligence rating, 

In order to chock the operation of selection versus training more 
exactly, in January, 1923, when the fi*eslnnen tested in 1919 were 
seniors, the number of survivors in each of the original qunvtiles 
was tabulated (see Table III). The percentage of the survivors 
ranking above the median was found to bo only 61 per cont, a 
figure somewhat below that for senior-frcshman comparisons when 
two classes are tested simultaneously, the former in their senior 
year (84%). The 25, 60, 75, lOO percentiles for 1923 seniors were 
also found to average only about G points higher than those for 
the same group as freshmen, although the discrepancy between 
senior and freshman medians for 1922 and 1926 (tested simul- 
taneoualy) was 18 points. Granted that the quality of entrants 
has not deteriorated from 1917-1921, individual improvement would 
seem to play a more important role than selection iu raising senior 
scores,’ Even so, the rise to be credited to senior superiority in 
training—in knowledge, aplomb, concentration, grasp, or wlm-t not 
—say 10 or 12 points on the average, forms only a fraction of the 
total range of difference in abilities in the original group (BO to 
100 points). In other worda, three years' college training would 
avail, presumably, to shift the rank of a given individual hardly 
a couple of deciles—a conclusion home out by the records of re¬ 
testing in the sophomore year, where the average gain approxi¬ 
mates a decile, 

^Tlic fact tlint siioies vary on the nvoruge luvoraply with L]ie nge of the 
subject, from 10 to 21, mi^ht also be cited aa evidence tlint the teat mens- 
\ireH, not amount of trnlnlKE, but notWe ability. 

"AlttioUBli, before proccG«liiig to nay aucli couduslon, iJie umiBiinl Ioascs In 
tlie upper teat find gnide decilea of 1023—Inrecly tlirouifli transfer to otlior 
instUtitloiiH—Bbould he drinvii Into the cnlculntlon. 
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TABLE HI 

RATING OF SENIORS WITHIN TUB FRESHMAN QUA:IT:L"S, DISTRIBUTION 
1921 1922 1921 1922 1923 

Fcr Pvoblo.ns Ccvrecl Fcr Adjusted Sccra CjiTect, Adj. Score 


Quartile* 

IV 

Frequency 

17 

21 

18 

20 

13 

11 

III 

7 

9 

7 

7 

10 

10 

II 

2 

2 

1 

4 

8 

9 

I 

3 

.... 

3 

1 

3 

4 


— 

— 

— 

— 

_ 

_ 

Total 

29 

32 

29 

32 

34 


Above median, 24 

30 or 

25 or 

27 or 

23 or 

21 or 


01 ’ 83 pr ct. 93 pr ct. 86 pr ct. 84 pr ct. 66 pr ct, 61 pr ct. 
*Qiiai’tile rank in terms of 1924 freshman records for 1921, seniors 
in terms of 1925 freshman records for 1922, seniors 
in terms of 1923 freshman records for 1923, seniors 
LATIN ENTUANCI3 CREIJITS AND INTELI.IOIQNC'R IIATINO, 

In order to estimate the possible detriment to the student body 
of altering the conventional Latin entrance requirement of the 
eastern colleges, both intelligence rating and academic standing 
for the freshman and sophomore years of students whose entrance 
certificates showed respectively 4, 3, 2, 1, or 0 Latin credits were 
tabulated. As shown in Table V, the median intelligence rating 
of those offering the standard number of units (4) is only slightly 
above the rating for those offering fewer. Further, the individuals 
of the two groups are similarly dialribulcd over the ten test 
deciles, and the ratio of students above and below the median is 
practically the same (1 to 1) in each division. Adhering to the 
old 4-point Latin requirement would have cost the college 6 out 
of 15 of the most promising members of 1923; 4 out of 11 of 1924; 
and 2 out of 12 from 1925. If the intelligence test is a reliable 
indicator, the 4 unit Latin requirement is no longer the sieve for 
eliminating the weaker students which it seemed to be ten or 
fifteen years ago, when the brighter minds in the secondary schools 
were urged to complete the four years of Latin in the classical 
course, and failure to do so was a fair indication of either sloth 
or stupidity. This requirement now cuts out the sheep along with 
the goats. 

From the point of view of academic success, at least in the 
sophomore and freshman years, the comparison of the reduced 
credit with the standard group is leM favorable. The median 
grade for the former is somewhat lower, the number of students 
above the class average proportionately smaller. At the same 
time, the students of this group range through all the deciles of 
grade rank, and their elimination through a 4-point entrance re- 
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qiiiremenl would luive coBb the class ol 1D23 5 out of its besfc 13 
stuclenta; 192'1, 1 ouL of 13; 10213, 3 out of 11, 

A.ssiffiimenL of Liu; reasons for the _sUKhtIy lower academic 
achievement of the Sweet Brim* student with reduced Latin en¬ 
trance would be impossible without a fuller analysis of the con¬ 
ditions Bovei'iiinff adinission than is here ju-acticrblc. There is, 
however, no real evidence that it iiidicaLcs that the lacU of Latin 
handicaps tlie .student in either linguistic or scientific studies,® It 
may indeed signify that tho steadfast pursuit of Latin studies is 
still in a degree a measure of the scholastic ambition and energy 
of the special group' of .students who apply to Sweet Briar for 
admission. This latter view would, in fact, seem to be supported 
by Lhc falling away of 3-0 point Latin entrants in the sophomore 
year, ua compared with 4 point—sec Table V, in which the ratio 
of the former to the latter drops from roughly 1-1 to 1-2 for 1923, 
from 3-5 to 1-2 for 1924, in the sophomore yeax’S aa compared with 
the freshman. Tin's falling oJf is not, however, to be ascribed 
ontiiely to lack of scholarly anibition. The inability to obtain an 
A.B. degree on less than the full Latin entrance requirement 
opevnLcH either to discourage students fi-om continuing in college, 
or to encourage their transfer to other In-stitutions, e.g., state 
unlvcvaiLies, wliorc the lack of Latin is not a handicap, Tho clTort 


TABLE V 

LATIN KNTUANCB CBBDITS AND INTEIXlGHNCli RATING 
FRKOUENCY OP CREDIT GROUPS 


Cla>ss 

No. 4 

3 2 

1 

0 

Tot, 0'3 Credits Year 


Fresh-1923 

149 79 

18 

82 

5 15 

70 


man 1924 

116 71 

14 

24 

7 

45 

1925 

110 73 

17 22 


4 

43 


1923 

4G 




27- 

Sopho¬ 

1924 

44 




20 

more 

1925 

60 




32 



CREDIT 

UNITS AND 

INTELLIGENCE 

RATING 



Median Test Deciles 





1923 

G 

6 G 

4 

0 

5 


1924 

G 

6.5 4 


6 

5 


1926 

6 

5 G 


4.5 

6 




ACADEMIC RANK 




Median Grade Deciles 





1923 

6 

3 4 

4 

G 

4 


1024 

6 

3 5 


4 

4 


1926 

7 

4 5 


3 

4 



‘Tlir' lOiiKllMli t'liliU'S for I1n' 1 Uiiil L:H1ii liHl(rlonl.il<‘K oI r.ri.’i ailiiiilly 
nM-nitTf luivcr llinn Uiosu lor lhc ‘J tiiiiL uroiip. 
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to make up the missinp Tinatin credits in coIIcro in order to enter 
tor the A.B. degree while curryinR full frosliinnn worlc also oper¬ 
ates to lower their ncndeniic status. In any casi;, it is obvious that 
the effect upon the intglliKenco level of Lho .student body of lever¬ 
ing the Latin requirement has not been ut nil na dolorous as the 
Latin cnthiisinst.s were wont to predict. 

TABLE VI. 


COnUKI-ATION OF TKSTS AND (JIIADKS 





Soph, nnd 


Jvim, 



Ereali- 


Fresli- 


Soph,and 

Jun.aiid Four 

Year 

man 

N'n. 

mnn 

No, 

li'vtish. 

No. Senitii' Yeciys 

1923 

.43 

140 

.43y^ 

78 

.517 

38 

1024 

.42 

112 

.48 

Gi) 



1925 

.44 

113 





1021 

.34 

21 

..39 



.48 Hi .48 


PREDICTIVE VALUE QE THE TEST 

Throughout the above discussion, the value of the Thuvstone 
test as an indicator of ability has been more or less nssuincd. It 
remains to examine iLs claim more minutely, to determine the exact 
dt'Sree of reliability of the test in rolntion to success or failure 
at Sweet Brim' College. With this object in view, the test scores 
htue been correlated with instructors’ estimates/ iind with academic’' 
grades for from 1 to 3 years. The tost raLing.s of sLudunt.s drop¬ 
ping out and venuuning in each class have been compared. A 
number of mcmbcr.s of 1!123 and 1924 Imve been re-examined with 
an alternative form of the test, Cases of marked discrepancy be¬ 
tween scores and aciideniic ranks have boon carcfidly analysed, and 
the health records of each class scrutini'Acd far whatever light 
they may throw upon the problem. 

■'L'lils iiioLlioO of U'stlntf out till' Bcoi'os wnw nlxindomJd nii iiccoiiiiL of tlie 
illllk'niLy of Bi'ciii'liig fiioiiUj' owtluiiitcfi of inlullltfOJico^on nny oilier tiftfila 
llaili Uiiil i>£ intiHs innvks In Llio ilopnrtincnl tdiicorncd, 'l')io coi'rehltlon of 
tcsis lUiU OHUuniivis fov HI‘iS ^Yll« .-ISV;., only ij imhiL inglioi- tliiiii Unit fuv 
lusts uud Ki'udi's. 

'"KoKurs, rciuii'UnB'lS2 (fonchci' fi'CHlimuii, lliuls ii corvi’liiddu of .37'/j for 
the Thorndike ic-sts iiiiil rn^sJiimiii i:i'iiduH (sou Jinirndl (if nducaLloiml I’ny- 
choIoKy, Aiu'll, 1020, ii, 181; .'tIuiKni 'iVsls ns ii Muiins of .Si'lccllng nnd CJnsHl- 
fyiiifi Ciil|i-Kf’ tiiuik'iiiR), 'I’ll'* ciivi’t'lailojis lM'twi'(*ii gi'nilcs nnd Army Alidin 
I’ciinrtfd fnim Viili*, Oliio, nnd KynictiSG PiilvL>i'sltlo.« njiipi' from ,21) lo .Jl- 
lllt'lil‘1’ t'oulAclL'iils ai’L* occn&loiniily i-uporlcd for siiuulnl tu.sls, 
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Test Scores nnd Grade Rank, After trying out and discarding 
various inetnoda of weighting, the following procedure was 
Adopted, The letter grades ot onch student for the year were 

converted into numbers (following the scheme A=ll, 4-10, 

B+=-{), etc.) and the total obtained. This total instead of the 
usual average was then made the basis of a grade ranking, and 
coiTelnlion coe/licieriLs with test rating (based upon adjusted 
score) obtained. These cooIRciGnts (R, calculated by the Spear¬ 
man foot-rule, xl,[)) arc shown in Table VI, The figure for the 
first year grades is about the same for all classes, +.43, and ap- 
pi'oxiniate.s that usually quoted for freshman groups of fairly 
homogeneous material-’ When sophomore and junior grades are 
added, this figure rises to .517 for the 38 surviving members of 
1923. 

A clearer notion of the degi’oe of correspondenee (or divergence) 
between tost and grade rankings may be obtained by dividing each 
class into four sections or quarbilcs, first on the basis of their test 
ratings, second, upon that of their year's grades. The number of 
Students occupying a siinilnr qliartilc in each set of measures may 
then bo computed, also the number occupying the highest quartile 
in one and the lowest in the other, i, e., the number both of 
coincidences and of ab.soluLc disagreements in rank, E. g,, as 
shown in Table VII, 22 individuals out of the 35 in the highest 
test qliartilc for 1923 rank also highest in froshma nscholarship; 
14 out of 28 for 1924; 15 out of 28 for 1925, At the same time 
the range of academic achievement for any given degree of test 
performance is wide, and a few individuals fz'om the lowest test 
quartile in each class attain the highest grade quartile, at least 
in their freshman year. The percentage of the group maintaining 
the same quartile rank in both sets of measures is 43 for 1923, 
42 for 1024, 39 for 1925." This means that we would be absolutely 
right in the case of about 4 out of 10 students in predicting their 
quartile rank in scholarship on the basis of their quartile position 
in test rating; absolutely wrong in the case of only 3 or 4 out 
of 100 (these latter discrepancies being I'educed .or eliminated 
when the ranking is based upon the grades of latter years.) 

"TliC c-orix-.si)aii(Ilng /iffUrfl given Izy Hueers Is only 3D?fc. Whether this 
lluliciUoK Ihe liltflior rOliubUlty o£ our scoriJ.s, or llio loss aeloctud and homo- 
t'Uheiui.S' clijirijclor ul lair groui), L ilebnliiblu. 
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TABLE VII. 

Quartile CoiNcmENCR In Test Anh Guadr Rankings 
A. 1023 FRESHMAN GRADES 



IV 


III 

II 

I 

IV 

22 


7 

5 

2 

TESTS III 

0 


13 

7 

11 

II 

2 


8 

12 

9 

I 

2 


9 

11 

15 

Nq. Subjects 

35 


37 

35 

37 

Total 





144 

Coincidence 





C2(43fo) 

Disagreement 





4(2.79fe) 

B. 1023 JUNIOR, SOPHOMORE 

AND FRESHMAN 

GRADES 


lY 

III 

II 

I 

Totnl 

IV 

5 

5 

0 

0 

10 

TESTS III 

2 

1 

C 

4 

13 

II 

1 

3 

3 

1 

8 

I 

1 

1 

1 

4 

7 

Totnl 





38 

Coincidence 






Disagreement 





1 


C. 1024 FRESHMAN GRADES 




IV 


in 

ir 

I 

IV 

14 


8 

5 

2 

TESTS III 

5 


11 

7 

6 

11 

8 


4 

8 

7 

I 

1 


5 

8 

14 

No, Subjects 

28 


28 

28 

28 

Total 





112 

Coincidence 





47<42%) 

Disagreement 





3(2.6%) 


D. 1926 FRESHMAN GRADES 




iV 


HI 

II 

1 

IV 

16 


7 

4 

2 

TESTS ni 

5 


9 

9 

G 

II 

4 


10 

7 

8 

I 

4 


4 

G 

13 

No. Subjects 

28 


30 

2C 

29 

Total 





113 

Coincidence 





44(30%) 

Disagreement 





0(B%) 


•ntilscd lo W/e wlion Hic lost riiiArtllc.s are Gduiillscd, on tlio liiisls of 
the 38 romnlnliic nicmbers of Uic class. 
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E. 1921 FOUR YEARS GRADES 


IV 


IV 2 

TESTS III 2 

II 0 

I 1 


Total 

Coincidence 

Disagi’eeinent 


III II I 

0 2 1 

3 0 0 

13 1 

10 4 

21 

12(57%) 
2(9,B%) 


Foi* the tost ranking of those delinquent in studies at the end 
of the freshman year, also of significance here, see Table XI. For 
a corre.sponding group Thurstone reports delinquents to the num¬ 
ber of 0, 2, 3 and 0, for the test quartiles 4 to 1. 

What is the real significance of thc.se figures? Can a test which 
yields a correlation coclficicnL of less than .80, a percciilagp. 
quartile coincidence with grades of less than 75, be of utility in 
ji college olTicc, either in the guidance or elimination of students? 
Should material or method be modified, or is the quest hopeless ? 

In answering this question, the nocossity must first of all be 
emphasized of considering the grades for the entire college career 
of the student before passing judgment upon the test as prognostic 
of academic achievement, Grades, always tricky, are .specially 
open to attack in the freshman year. First of all, there is the 
{allibiUtij of the instmetor, possibly too easily impressed by n glib 
inomoi’y, poise of manner, a fluent tongue. Second, the rftricnicc in 
ranfchjp sUmdavds in dilfei’ent departments, iHustraled by the fact 
that the median freshman grade in the vaidous subjects ranges 
from C minus to C plus for 1924, from C plus to B minus for 1925 
(C=rair, D=Conditioned, B=Good); while the middle point in one 
subject rose from C minus in 1920-21 to B minus in 1921-22. 
Third, owing to a certain latitude of choice in subjects, even in the 
freshman year, deceptively high records may be achieved by 
students doing very little real brain work; especially in the case of 
courses based upon material already familiar to the well-prepared 
student. 

There is also to be considered the routine character of 
freshman courses, involving on the whole more of a memory grind 
in graminar, formulae, and fact, than later, more advanced, and 
elective studies, which arc par se better fitted to evoke veal reason¬ 
ing ability and initiative in the student. Lastly, from xhe point 
of view of the individual freshman, there is the chaotic characier 
of the first year in college, involving as it does adjustments to a 
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novel envivoninGnt, collision of social and intellectual ambitions, 
as well as submission to n move or leas arbitrarily imposed curri¬ 
culum, in which the special bent of the individual may be ignored 
ov thwarted. All these factors conspire to lower the value of 
freshman grades as prognostic of future academic success, and to 
prevent the individual student fi*om finding her true level in the 
freshman year. An easy schedule or s\«Kie-m\ndcd industry may 
run up a record unduly; the reverse foctors lower it. 

Even, however, when the upper class records arc at hand, the 
indications are LhaL the correlations will hardly ri.se higher than 
.60 or ,70. Is this to be ascribed to the shortcomings of this par¬ 
ticular test, or is it inevitable in all mental testing of college 
women, representing a comparatively narrow range of abilities 
and subject to certain other peculiar conditions? It is a matter 
of common knowledge that many factors apart fi’om intelligence 
enter into the determination of acadomic success. Health, ambi¬ 
tion, habits of industry, social distraction and diversion, worry 
and other causes may tip the scales one way or the other, Is it 
not likely, particularly in the case of a group of women, working 
less under the spur of strenuous vocational motives than do men, 
that the serviceability of any mental test is necessarily limited? 

Avifllj/sis of Gases of Marked Discrepancy between Test Scores 
and AcfldcHiic Rank- In order to apportion the blame between 
grades and tests, and determine if possible how far the test itself 
stands in need of alteration (in subject-matter, method of admin¬ 
istering, or scoring, duration, etc.) a number of cases of marked 
dislocation between academic I'ating and lest scores were selected 
for further study. Twenty-throe of these, along with a sprinkling 
of seven others to act as a control—^to the number of 30 in all 
for the classes of 1923 and 1924—^were re-examined in March 
1921 with alternative forms of the test blank. Secondly, a number 
of facts were collected and tabulated (see Tables VIII and IX) 
with regard to all freshman in whom the amount of dislocation 
is equivalent to at least % of the total range of rank for the 
group (representing nearly a quarter of each class.) 

A considerable amount of the divergence between the two sets 
of ratings proceeds undoubtedly from inadequacies in grade 
ratings, the shortcomings of which, especially in relation to the 
freshman curriculum, have been already commented upon. As 
shown by the table, when sophomore grades are substituted for 
freshman, the discrepancy with test ratings is materially re¬ 
duced; as a matter of fact, in three quarters of all such cases re¬ 
maining in college. Cases of apparent ovcrestiination by the test, 
rise on the average 2 deciles in gi'ade imnlc; cases of underesti¬ 
mation drop 3 deciles. 
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Nuvci’theksa, certain of the total number of cases in which the 
Rtudent's academic record exceeds the promise of her test per¬ 
formance, are probably bona fide instances of underestimation by 
Ihc tests. Seven out of ten of such cases when retested rose 
Severn) deciles in rank (although in the majority of control cases 
there was little change); and there is every reason to believe that 
the second tealinc: yields the truer measure of their real abiUtv. 
Various familiar strictures as to the fallibility of test data seem 
to be here substantiated—notably the objection that a low score 
may be o function not of native stupidity, but of lack of training, 
of poise, solf-control or self-knowledge, manifesting itself as nerv¬ 
ousness, flightiness, poor judgment as to the best balance to strike 
between speed and accuracy, exaggerated confidence or undue 
caution, Further, a scrutiny of the health records indicates that 
a certain number of the cases of discrepancy studied were laboring 
under some more or less temporary physical handicap, such as 
recovery from a recent operation, which invalidated the earlier 
testing. 

In cases of apparent ouc?'esti»iat/on by the tests, the health factor 
enters also, though in a dilYerent fashion. At least half of the 
individuals in lOlll and 192G who.se grades fall seriously below 
expectation (16 out of the 30), and practically all whose sophomore 
standing shows no improvement, have poor health records; while, 
on the other hand, the majority of casc.s in the class of 1926 in 
which the grade rating is surprisingly high have excellent health 
records, There is undoubtedly a cpiick nervous type of individual, 
capable of running up a high score in a half hour test, but laclcing 
the physical stamina (and with it the ambition), for the sustained 
effort essential to a brilliant academic career. In such cases, the 
high te-st score may sometimes be utilized to arouse dormant ambi¬ 
tion, but the wisdom of so doing is often questionable; and such 
individuals are frequently outdistanced by classmates of mediocre 
Ability but superior nervous and physical endurance. 

While the uncertainty and variability both of health factors and 
mental attitude complicate thus the exact prognosis of academic 
success or failure from this or any similar test, certain devices 
are available for increasing the reliability of test findings. Pains 
should be taken to stress the importance of the test results to the 
individual (without creating undue tension); to defer the test 
period, in case of the physically unfit; and to repeat the test (in 
alternative form) a month or more later, at least for those occupy¬ 
ing the lowest test deciles. Some more exact adjustment with 
regard to the inclusion of accuracy in the test score, or the weight¬ 
ing of en-ors, is also desirable. Something might also be gained 
by the supplementary use of n will teat such as Downey's or a 
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TAliLK VUl. 

1Mscr;:i*.\N('.u:h IUitwekn Test ann Ojjade Ra'I’ingh 

Oljiss of l\m 192.1 102B 




L, 


u 



i- 

~ 

r 

Grade Rai\king* - 


z 



Nuinbor of .Subjects 19 

il) lb 

fH 

n 

12 

Median Age 

17.8 18..1 

1 18.:) 

18,3 

m,i 

Iloaltli Poor 

h 

10 

f) 

G 

Freshman Covivse blasy 19 

K d 

10 



Left Before Sophomore Year li 

ll 9 

8 

5 

G 

Soph, Civade Iluting Neswev Test 11 

7 « 

.n 



Accuracy Rating Nearer Grade 10 

u r> 

10 

9 
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No. Rele.sted 7 

3 9 

;i 



Iletcslcd Nearer Grade Decile 4 

2 9 




Total 98 
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TABIiK IX. 




IlESui/i’a nr Rktiisting 




Class of 

1023 

1024 

Total 

No. Retested 


1C> 

i-l 

30 

Cu.scs Di.‘?cr(!i)uncy between Te.st and Grade 

18 

10 

23 

Control Ca.sc.s 


,8 

4 

7 

Second Test Ranking Nearer Grade 

Decile 

0 

ry 

11 

Av, Decile Deviation of Pre.sliinau Grades from 




Test 1 Rnting 


4.0 

4 


Av. Decile Deviation of Freshman Grades from 




Test II n.^itiiig 


3.0 

3.3 



Av, Decile TR?vinlion of Soplioniore /yriule.H from 
Test I Ilnti7ig 

Av. Decile Devi:itif,u of Sophomore grades from 

Test II Rating 2.0 

It may be added that the factor of nROj or vathev, that of 
youth, r.ocma also to complicate cmr results in a fn.shion not quite 
d’'cii)hei’nblc. There is ii tendency to .nii inverse relntion between 
cigc and tost rank, a direct one between age and grades, The 
precocion.S inind tests high, but a certain maturity of experience 
and purpose a.s well as of mentality is apparently desirable in 
order that higher studies shall be naaimUateci in their full value, 
and studious hnbits set up. The weight of evidence is uRainat 
lowering the age limit. 

Test and Grtide Rank oj Withdrawals, 

Another criterion of the academic value of Le.sL .'scores is aomc- 
times sought in an analysis of the case-s of wiLlulrawtil. For 
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SwgcL Di’iHr afcudentSt the distribution of the Josses (shown in 
TiiNti X) ia fairly uniform over all the test deciles, except in the 
case of 3923, for which class, the mortality in the lowest decile is 
conspiciiQUsly ffrentcr than that in the highest. Again, the loss of 
studenLs from the upper half of the test ranks is only slightly leas 
than that from the lower—roughly as 6 to C for 1923, and almost 
1 to 1 for tlie two later classes- Obviously test ranking cannot bo 
used at Sweet Briar to forecast the probability of withdrawal as 
suggested by Thurstone. Thai this is not, however, to be inter¬ 
preted its per se a I'cnection upon the roUabiliiy of to it rating:, is 
indicated by the second half of Table X; th- pjopovtion of ijtal 
losses for the upper grade deciles practically parallels that for 
the upper tost deciles—except in the case of 1926, where the record 
is as yet incomplete. 


TABLE X 

TEST AND GRADE RANK OP WITHDRAWALS 


Year 


TKSr RANK* 
1923 

1024 


1925 




(ISd)*'*-* 


(110) 


(116)** 


*7 

c 

■/. 

s 


"vJ 

r 

a. 

& 

u 

O 

X 

L 

.a 

e 

<A 

10th docile 

2 

5 

1 

% 

4 

4 

8 

4 

1 

1st (Icdlo 

10 

3 

2 

16 

4 

4 

8 

5 

3 

Above median 

20 

25 

3 

54 

26 

IS 

38 

17 

0 

Below median 

36 

23 

4 

03 

20 

17 

37 

17 

8 

Total 

02 

48 

7 

117 

45 

30 

76 

34 

17 



CllAOK 

1923 

HANK 


1924 


1926 




(140) 



(112) 


(113) 

10th decile 

3 

3 

1 

7 

2 

4 

6 

3 

0 

1st decile 

14 

1 

1 

IG 

18 

2 

10 

7 

1 

Above median 

24 

24 

2 

50 

17 

17 

34 

16 

6 

Below median 

35 

20 

4 

59 

24 

13 

37 

16 

11 


_ 
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— 

— 

— 

— 

■ — 

—■ 

Total 

59 

44 

6 

109 

41 

30 

71 

31 

17 
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wfitcrinl is .slight. Grunted the iw’ccfiiition of a second testing, a 
dead line for ndniission miglit bo drawn not merely at the 10 but 
even At the 2fi percentile—a score of about 72 correct and 73% 
accuracy (in terms of the records of 1923 at Sweet Briar, for the 
1919 edition), or better, at an adjusted score of 44. Where it is 
not deemed foasible to ruslc the reduction of the freshman class in 
this fashion, it would at least be desirable to encourage hy every 
means available the student.s of the upper quartile, to discourage 
the rctinui at the o])d of the freshman year of the students of the 
lowest Judfi'i?ig by tljc correlations and other data this course 
would in tliG end prove more satisfactory tlian merely seeking' the 
withdrawal of tiu! .student of the lowest ijrudc decile or quartih' 
The question of the suitability of the component elements of the 
two editions of the Thurstone teat for our particular task, and the 
value of each relative to the different branches of the curriculum, 
is reserved for discussion in another place. 



PREDICTION FORMULAE FOR TEAMS OF APTI¬ 
TUDE TESTS 


By Clahk L, Hull 
U nWevsity of Wisconam 

I 

The rapid odvaiicG in Llic: practical npi)litntion of teats to tlie 
prediction of aptitudes, promisca ‘ioon to liriiiK into foncral use 
scientiric prediction rorniulac, Witli llif! iiaHsinir over of tliis im¬ 
portant branch of test technique from the theoretical to the prac¬ 
tical, comes a rc-oxaininatiou of the properties of tlie regression 
cciunt'-'ii, I' W s'ciif-'i'My accejUrd as the sLaivlaivl prediction form¬ 
ula. It is th?. chief object of the preseut article to point out certain 
practical clilTicultics associated wtili tlio use of tlie regression 
equation for this purpose, and to propose a remedy. 

Suppose the employment department of nn iiuUistiy liii.s two 
jobs for each of which n team of teats has been devised nnd each 
team provided with nn nppropi'iato regression equntion. Let it be 
furtlu’.- sLipi oard that this employinont department has been in the 
habit of I'ating its employees on a .simple uniform scale such that 
the worst man in a hundred i.s scored zero, nnd the best scored 10, 
with the menu at 5; and that the diagnostic potency of the first 
team of tests (E) i.s .GO while Hint of the .second is .40. Now if 
such tin employment department should begin to use its tests and 
regression equations in the prediction of nplitiules of pro.spective 
employees and with exactly the same grade of men os previously 
employed, it would find that the highe.st prdicLocl score ever oh- 
Inined with the first equation would be 8, and the highest with the 
second only 7, iiirte-’d of the 1'^ Lo which it I -il been nccua'omcJ, 
If the empolyment dopnrfc-.Tient bad been :u the liabit of discharg¬ 
ing all employees known to be below score 2 in aptitude and had 
planned on rejecting all upplicaut.s who were indicated by the 
tests aa probably below this level, it would find to its surprise that 
the first equation would predict none at nil below 2, and the 
second none below 31 The oqunbions would tluia indicate no ap¬ 
plicants as being either very bad or very good, If the employ¬ 
ment department should desire to reject the lowest 26% of all 
applicants, it would have to select n radically difTerent score from 
the score marking the lowest 26% of its nctunl employees. Not 
only this but it would have to select a distinctly different score to 
accomplish this with each of the two •regrcs.sioii equations. Or, 
to consider the matter from the point of view of the order of 
merit, a predicted score of G by the first team of tesLs corresponds 
to a vnuk of tenth from the best in n hundred, whereas the same 
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score with the* second- team corresponds to n rank of third from 
the best in a hundred. 

Now the cause of all this confusion.lies in the fact that reerca- 
.sion ci|UJitions Inive an ineviLable and usually radicitl tendency to 
narrow the range of distribution of predicted scores ns compared 
with that of the original criterion. This is at once evident fro-m 
an in.spGcfcion of the bfii?ic regression eciuation,' 

O' . 

x=r-y .(1) 

when it Is I'GC'allod that r is always less than unity. The operntion 
of this tondeijcy i]i the cn.se of multiple correlation jnay be ahcrvvn 
by means of the following miniature problem, which will also 
serve to illustrate certain other principles to be brought forward 
later. The original data of the problem are given in Table I, 
together with the result.? of the necessary preHnnnary computa¬ 
tions for the regression equation. 

TABLE I 


Subj. 

Criterion 

Test A 

TestB 

Correlations 

Partial S.D.’s 


(1) 

(2) 

(3) 



I 

2 

8 

8 

r,,=+.G2B 


II 

4 

6 

6 

rn='I-.5626 

S. D.i.,3=2.78 

III 

(1 

7 

2 

r..^+.37S 

S. D,2.is— 1.6G' 

IV 

1.9 

!) 

14 


S.D,2.,3=3.31 

V 

10 

11 

6 

r„.,=-h.642 


Mean 

7 

a 

7 

r„.,^+,4Ba 


S. D. 

4 

2 

4 




Dropping the smaller decimala, the primary regression equa- 
tion on this criterion is, 

Xi=.9GSx2-|-,3Slxn .(2) 

where the x’s are the deviations of the individual subjects’ scores 
from the means of the seimvaLe array.?. SubsLitiiLing in this to ob¬ 
tain an equation in which actual test scores may be used for pur, 


poses of prediction, 

X.-7=,9G8(K,-8)-h.381(X,-7) .(3) 

Clearing,- and collecting, wc obtain, 

Xi=.968X..4-,38lXi-3,41 .(4) 


where the X’s represent actual scores. This is the form of the 
regression equation ordinarily used for purposes of prediction. 

*Yi)lf‘, 0, 11.; JillrfJtJlio/imi Ifi llic Thocry ii/ U- l”t 
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SubstLtutine in equation (4) the test scores of each subject 
shown in Table I, wc obtain by successive appliention, the follow¬ 
ing: “predictions": 


Subject 

Predicted 


score 

I 

7.38 

II 

3.33 

III 

4.13 

IV 

lO.fni 

V 

9.B2 

Mean 

7,00 

S.D. 

2.877 


These predicted scores coiTelnte with the criterion to the extent 
of d-.719. The mean of the predicted scores is seen to be, ns always, 
the snine as that of the criterion, 7. It will be noted, however, 
that the S, D., as would bo expected fi’om the nature of the re¬ 
gression equ.ation, is much less thnn that of the criterion, being- 
only 2.877 as again'-h J. This is what causcil the cc.nfii.sion noted 
above, 

II 

As inclicntod by equation (1) the amount of shrinkage in the 
dispersion of the predicted scores is dependent upon the size of r. 
In cases of multiple correlation such ns the jmo.sonL whore we 
have a predicted criterion derived from a. set of weighted tests, 
the shrinkage in dispersion is dependent upon the size of th cor¬ 
relation between the prcKlictcd and the actual criterion scores. Yule 
has flcsignalcrl this cDi'Tolntion us R*. Thus in the above cxjDnple, 
if the S. D, of the criterion (which is 4) be nuiltiplied by R- (.719), 
the result will bo 2,&77, which ia identical wth the S. D. of the 
predicted scores as obtained by actual computation. Knowing this 
relation then, wo may write the formula, 

X,=;cbi 2 ,sXa+ebis,sXs .(B) 

■where 

1 

c=- 

R 

and all of the other symbols are the same as employed by Yule. 
This formula, while leaving the correlation between the tests and 
the criterion undisturbed, yields a prediction series with exactly the 
same mean and degree of dispersion as the criterion itself, thus 
eliminating the objectionable features of the regression equation 
noted above. It is accoi’dingly pi'oposcd for use in vocational and 
employment prognosis. 


‘Yule, op, clt. D. 249. 




rREDlCTlON FORMULAE 


280 


In detcrmininK II, it may be recalled that it is not necessary 
aQ^•unlly to iTifilcG the predictions and then compute the correlation 
between prediction and criterion as above, in order to find R for 
use in fornuiln (6). R may be found very readily by formulae of 
tlie following Lypoi^ 

Ri-jj—Vi—(1—r’lj) (1—.(G) 

Substituting appi’oprin.tely in equation (G) from the values given 
in Table I, 

Ri,»=: V fr(l-7Q26*)( 1^.452*) 

= ,715) 

This agrees exactly with the r computed from the predicted and 
the original criterion scovch in the ordinary manner. 

The operation of the proposed px-cdiction formula (B) may be 
ilkisLratGd by moan.'? of the example already considered. Substi- 
tuting the value of It In the formula for c, 

1 


.719 

=1.391 

Substitulinj? the valuo of both c and b in formula (B), 

X, = 1.391 X .908 X, H- 1.391 X .381 Xs 

xj = X, 1- .S.TO ..(7) 

Etpiation (7) i.s analogou.s to tM/nation (2) nbovc. From hwe on, 
the procedure i.s exacUy like that with nn ordinary regression' 
eQualion. .Substituting the vuluc.s of tlie means as in equofion 
(3) and solving, we have, 

Xi = l.;m K: + MO X, - 7.468 .:.(8> 

Substitiitinft- tlie tost scores of the various subjects in (8) as was 
done in (*1), the following prccllctioiia arc obtained; 


{Subject 

Predicted 

Score 

I 

7.629 

ir 

1.844 

III 

3.007 

IV 

12.051 

V 

10.506 

Mean 

6.987 

S. D. 

3.095 


R— .7X9 


(7. 

(4) 

It will bo observed that in this prediction, not only the mean is 
the same as that of the original criterion, but that the standard 
deviation is also the same. The shrinlcage in the dispersion of 
the predicted scores caused by the regression equation has been 
corrected by the prediction foi’inula (5), and the stft-nclard clevia- 
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tioii restored to its originnl size of 4* The correlation is entirely 
undisturbed, standing at .719 exactly iia before. 

It is to be noted tlmC the prognosis foi-niula omployod above 
is not itself a regression equation. The true nuiltiplc regression 
equation serves two distinct functions. One funcLioii is to give 
the weiebt that each teat score should be multiplied by, that nil 
eombiiied’shall yield the maximum corrolntion with the oritorion. 
Iiinumerfible such optimal weighting-s arc poHsiblo, since all that 
is necessary for tliis is that a certain optimal proportion shall 
be maintained among the weights given to the various tests. 
The second function of the regression equation is to indicate 
the pnrticulfir set of optimal weights that, when tlio tost scores 
are multiplied by them and combined, they will yield the most 
]n’obablo aJxiohUe criterion score obtainable frmn Uie data. The 
proposed formula performs the first function but not the .second. 

To give the most probable absolute criterion .score, the rogre.?- 
sioii equation mu.st always reduce more or Icsts exLen.sivcly the 
disper.sion of the predicted score.s below that of tlie criterion 
ainiGcl at, This introduces an element o£ uncertainty into their 
use for employment purposes, very much like what would happen 
if predictions were to be made on a new and unfamiliar scale. 
Thus with n basic 10-point scale, llio maximum possible pre¬ 
dicted score may vary from 6 or so, up to above 9. For this rea¬ 
son a predicted score of G.6, any, has little meaning when applied 
to an individual subject. It may mean that he is probably only 
slightly above the average applicant in aptitude, or it may mean 
that he la probably the one host appUcaxit in a hundred. The 
predicted score, standing alone, gives us no light whatever as 
to which of these two extremes is more nearly approached. Un¬ 
fortunately this is exactly what the employer wshes to know 
from a team of tests. By i‘esloring nil predicted di-spersion-s to 
the size of the standard criterion aimed at, the proposed formula 
eliminates this ambiguity. 

It is also easy to show that, in spite of the fact that the 
regression equation yields the most probable absolute predicted 
score, its ordinary use in employment may lead to unfortunate 
results. Let us revert to the employment situation instonced, 
above (Sec. I). Suppose the labor market to be such that it is 
necessary to hire practically all applicants, the two teams of tests 
being used merely to decide in which of the two jobs a given 
applicant probably has the greater aptitude. Let it bo further 
supposed that aptitude in the two jobs ia positively correlated. 
One result would be that men of fairly equal but low ability oii 
both jobs would tend to score higher on the second job, since 
the low R of this team of tests tends to raise all low scores 
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towards tho mean, thus tending arbifreiaUy to shunt the poor 
workers into the socoml job. On the other hand, subjects having 
relotively equal hut high aptitude for the two jobs -will tend to 
score iower on the second team of tests because the low R in 
this case lias lowered towards the mean predictions from all liigh 
scores, thus tending ui'tilicially to shunt the good workmen out 
of the second job. As a result of this tharc will bo a tendency 
for the poor- workmen to be segregated on the second job and 
for the bcttci' wovknien to be segregated on tho first job. But 
witli Ibe proposed prognosis formula, since the range of predic¬ 
tion would be exactly the same for both teams of tests, the un¬ 
fortunate tendency noted above could not take place. It would 
still be true, of course, that the predictions made from the team 
of tests with the weaker B. would be less accurate than, those made 
from that with the stronger R. 

HI 

It will not infrequently happen that tho original unit of meas¬ 
urement of a criterion will be such as would be undesirable for 
use in prediction. For example, the original criterion of the 
elTicioncy of lathe workers might be b set of careful micrometer 
readings showng the deviations from specifications of certain 
products turned ouL by tho subjects. Obviously such a criteriah, 
while probably excellont from the point of view of reliability, 
would hardly be suiTtciently intelligible for general use in the 
prediction of aptitudes*, 

A special need to make predictions in terms other than those 
of the original criterion measurement will arise* where it is de- 
Bired to predict Iho aptitude of a person on a number of different 
vocations for purposes of comparison, with n view of determining 
in which he is most likely to succeed. Such comparative predic¬ 
tions, it would seem, must become very general if scieiitific voca¬ 
tional guidance is to become a reality. To be readily comparable, such 
predictions should all be made in terms of the units of some 
simple uniform scale, e. g. one of ton points. This scale will 
ordinarily not (except by chance) be the same as that of the 
oinginal criterion mcasuvemenl. For such cases the following 
method has been derived by means of which predictions may be 
made in terras of scales having any desired means and any de¬ 
sired standard deviations, quite irrespective of what the corre- 

'A riUlU'r ooinmiin form of Hits (lllHoiUty roau‘»‘lnK K!'cp1u 1 trontiiU'nt is 
wtici'O, us so urioii cub' nvuHiililt* prlltfi'lon Is ii set of I'juiku of 

tlip suliji'cts lu tin- UPllvUy siutlU-'cl. UauIiM are not only imsiitlsfi\clc)i-y 
unllB fur iuiri)os>‘s o! proilirlloii, liuL iU('iilllcnnt rogiTSslon ((lUiilioos onii- 
noL 1)0 Itnscil upon flioiti. For swell ciihch, ii incthotl of converlinpf ranks 
Into lliii-iir nnliH couvonjont li»r puriiosoH of iirciilellon nnti uiioii wlilcli 
TegtesHtnn e\i\nu.Wns n\oy tns Imseil, ts lieBcrlUcd iu tUts Jouviml Vol. Vt. 
nn, flK.' ff. 
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fiponcling values oi! the original criterion scales may have been. 

The procedure is first to work out the primary regression 
equation on the basis of the original ci’iterion niensiiromont ex¬ 
actly na in (2) above. Then if we let o', bo the S. D. of the 
original criterion scores, and^,' be the S. D. of the scores to bo 
predicted on the desired scale by the prediction formula, we may 
wi’ite, 

c =. .(9) 

Il<r, 

This value of c is substituted in equation (6). LnsLly the mean 
of the desired prediction series is used in place of that of the 
criterion series when the x-values are converted into X-values 
as in equation (3) above. 

The concrete working of the method may be illustrated by trans¬ 
forming equation (6) into one which will predict in terms of n 
10-point scale with the mean at h aiul with a S, D. of 2. Sub¬ 
stituting the appropriate values in (9). 

2 

c = - 

.719X4 

= .Goa 

Substituting the value of c in equation (5) and solving we have, 

X, = ,0729 x= d- .2649x, .(10) 

Substituting in (10) the values of the means na in (.3) above ex¬ 
cept that here B (the dcsh'cd mean of the new predicted scries) 
replaces the 7 of the original criterion aeries, we have. 

X, - B = ,6729 (x, - 8) H- .2640 (x, - 7) 

Clearing and combining, 

X, = .6729x1 + .2649x, - 2.237B .(U) 

This is the formula that we have been seeking. 

Lastly by substituting the test scores of Table I in formula 
(11) we obtain the following predictions, this time in terms of the 
desired 10-point scale: 



"Predicted’ 

Subject 

Score 

I 

6.266 

II 

2.463 

III 

3.003 

IV 

7.528 

V 

6.763 

Mean 

6.000 

S. D. 

2.000 


It •wiil be observed that the prediction yielded the required mean 
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flnd standard deviation, and that the correlation is still undia- 
turbed. 

The same results as secured above may be obtained quite 
simply by converting: the undesirable criterion scores into the 
desired preiliction scale before the zero order correlations are 
computed. Tiiis iiiny be performed with case and precision by a 
method ricsciibcd iti this Journal, Vol. VI (p, 298 ff.) 

In case it should be desired to predict in torins of a scale 
di/FGi’ciit from that of the original criterion but by mean.s of a 
true regression equation instead of the prediction formula ree- 
omiiicnded above, the procedure is exactly the same as that just 
•described, except that in this case, 



labor turnover and metal alertness 
TEST scores 

By a. J. Snow 

NORTHWESTEnN UNIVERSITY 

That labor turnovor is an over present problem anil a costly one 
to the industrial institutions tlmt harbor it and to the community 
generally is admitted by students, Some industrinl inaiuiEcrs fully 
realize the waste involved in the maintenance of an unneceasarily 
large labor turnover; if there is any one who doubts it, it is that 
group of employers who do not posscvsa the capacity to move along 
mentally in the realm o£ industrial relations with the constant in¬ 
dustrial expansion. It is well known that this larger group, com¬ 
posed mainly of inefficient and dogmatic employers, is the 
greatest single obstacle in eliminating this form of social Waste. 
That this group of men is nhvays willing to assert thoii superior 
and infallible knowledge in handling employees, is an ever present 
experience of the student in this field, and that tliey have almost 
complctey failed in dealing with this problem as well ns with the 
other pi’obleins of industrinl relations, wo have proof of in the 
increasing industrial unrest. 

Labor turnover is not only an industrial problem, but directly 
a social and community problem, this can bo seen wlicn we renlize 
that waste in any form ndda to the actual cost of production, which 
ia paid cxcntually by the community of con,suiners, To point out 
only five of the many items which aro chargeable to this form of 
preventable waste, from, the point of view of management, we have 
the following: first, expense incident to employing; .second, instruC' 
tion to the new employee by the foreman; third, .spoiled work be¬ 
cause of new surroundings, new tools, etc,; tlie same ia true of the 
fourth factor,-—breakage of tools and machinery; fifth, decreased 
production due to the temporary low production of new help. From 
the point of view of the ill-placed employee, we can enumerate the 
following three factors: first, loss in wages incident to the change 
of jobs; second, decrease in earnings due to the poinod of adopta¬ 
bility to the new job; third, decrease in earnings duo to mia- 
placement. 

It has been known to industrial psychologists, some of the moro 
enlightened employers and a handful of economists tliat wages 
and working hours are not the only industrial problems; in fact, 
wages and hours, ns an incentive, are subordinate, or, at most, 
on a level with the control and distribution of power within, an 
industrial organization. All that one has to do to verify this 
hypotliesia is to estimate the number, magnitude and importance 
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o£ disputes over the distribution of power as compared to that 
of waf^cs and hours In any industrial court of arbitration of long 
standing, such as the industrial court in the clothing industry. 
The saiTiG may bo said of our present problem—labor turnover. 
The casual observer is certain that the moat responsible factor 
for an abnormal labor turnover i-s the woi-lter's di-ssatisfaction 
with his waRci. The student of the subject knows, however, that 
(lis-saLisfaclion willi wages will not alone induce the worker to 
change his job, much less to give it up with the ever-looming 
possibility of unemployment. Most human beings must feel that 
the change will be beneficial in moi’o ways Ihnn one. As a rule 
thove arc a number of factors contributing to the worker’s de¬ 
cision to leave, and some of these may very well be of the fol¬ 
lowing nature: abuse of power—perhaps the greatest soin'ce of 
dicsalisfaction—wages, hours, unsanitary conditions, arbitrary 
ftdvancomeni policy, lack of instruction, faulty macliinery or tools, 
heterogeneous "conscioiisne.ss of hind" among learn worlcers, 
personal incomiuitibility with immediate superiors, lock of stan¬ 
dardized methods of process, lack of insli’Uelioii, lack of spe¬ 
cialized training on the part of the worker, economic insecurity, 
physical incapacity, mental incapacity and a mentality too great 
for its task. 

Statistics are nnfoi'tunately lacking as regards the comparative 
importance of most of these various factors. However, some 
interosting data has recently been gathered in connection with 
the two last factors. While admitting the danger of any study 
which aims to dissociate any one factor from ita immcclisite sur¬ 
roundings, nevertheless, such a study may be justified on the 
grounds of its illuminating I’esults and their actual usq, when 
other factors composing the complete situation are given due 
■weight. Consequently, the statistical study as to the relation of 
mental alertness and labor turnover that is to follow must not 
be given undue prominence in the mind of the student of the 
general and wder problem of labor turnover. 

The Scott Company has found the following tendency in their 
practical application of psychological methods to industrial man- 
ngGinent—that, when all of the men in any organization, e.vcluding 
major and minor executives, are given the Scott Company Mental 
Alertness Test', the score so obtained tends on the average to 

•Mosl u>^ycli(ilo(rists ri'coBn***“i '“ol rlglilly no, a tloeislvo (llltoranci; ()c- 
twouu uuintul wk"vUwss mul luu-Ulgouci*, mimiiU iUi*rljicss lu'iiiv (inly ono 
Ciiciov In Iniulll{{i^nce. See, o. g., tJimlt, Noviol /'sj/r/io/oyy (Holt, IU2:)), p, 77, 
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change with the worker's occwpatioual gvoup®. This tcmlcncy 
would suggest that a worker's place in an occupation which de¬ 
mands higher capacity for alertness than he is capable of would 
become either dissatisfied with his abnormally alow progress or 
would be discharged for incompotcncy. On the other hand, a 
worker of higher alertness capacity than is demanded by his 
present occupation, if not rapidly promoted into another field of 
endeavor where a higher level of alertness ia necessary, will 
become dissatisfied and lenve for n more promising job. The 
worker falling in this latter class is, of course, vci*y valuable to 
an industrial enterprise and the knowledge of his capacity in 
mental alertness would tend to save him for that industi'y which 
gives due weight to such information in their promotion and 
training policy. 

The following two experiments made by the Scott Company 
yield illuminating data, The first one was n study of the relation 
of the number of years each man was retarded at the time of 
leaving school—ns an index of mental alertnc.ss—as related to 
the stability of the working force in several production depart¬ 
ments of a manufacturing company. In this study tliore has been 
found a striking difference between departments, e. g,, in the tool 
department where the work i.s of a high grade and varied, "the 
greatest proportion of dissatisfaction occur.s among the workers 
who were most retarded in school. The stability increases as the 
amount of retardation lessens. . . " While in the inspection 

department of the same company, where the work is repetitive, 
monotonous and ‘fool-proof "the amount of di.ssatisfaction is 
low for those men who were very retarded in school. The per¬ 
centage of dissatisfaction increases markedly until, for those 
whose progress in school was normal. . . 

The second study dealt with relationship of mental alertness 
test scores and labor turnover. The psychological test used was 
the Scott Company Mental Alertness Tests,' This study has been 


=’All or the rrcslumui lit NortlniTfituni Unlvorslly liiul lo take the Scatt 
Company Mpntnl Alcvtiiu.ss Test. It linn licon fmiiul tliitt iiflor the Ifipso 
of one Bomestor tlint nil of tlio fre.sliinen thnt scoi-od In the upper mu'-tlilrd In 
meiitnl nlertncss tefits l)(l,3 per oenl ciiniec] n Rriule, which iC nvorftBed 
thrnuglioMt tliolv collego cnrci'r, would onahle them to 
fvesliniL'ii who acoieil Iti the lowest one-thlril In the nieiUal iilerliiess te.sts, 
only 2d per cent secured llie necessnry (rnulo for priuliiiuloii. ri'c'shiiian 
whose lilgh HChool scholnrslilp would pluce Llieiii In Ihe fiiurlli (iiiiirtur, nnd 
who were athulttcd to LUe rulversUy on seeuvlug the nwdlum or iilutve lu 
the nienlnl iilertnoss tests, only Kl.l) per cent reeidvoil (he uradc iit the end 
of the first semester, wlilch If kept up, would oiinhle them lo Bi'ndniite. 
(riie dntii for this note ivns secured from .Mr. Piiiil Lester Palmer, Nortli- 
western UulversUy.) 

®Sco([ and Hayes i'clciicc nud Ooiitmoii .S'cirsc (a Wurkliifi wtlli Men (Ronald 
1 ress, 11)21). p, 7.', For ii full nccouiit -seo also ji]). 72-2,'i, aiul the .Scott 
Cnniiiany Lahorntov.v lUilletln T,. No. K, Auffiist 3ll, 1020. This tiiillclln Is not 
puhllsliefi hilt mlmeoBTUphod 1 the Rnmo Is I rue of the Inillotlns reterrod to 
helow. 

n’rluted, not published by the ScoLt Company, Plillndelphln, Pii, 
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made upon the employees of three different companies. Tor the 
,inkc of convenience we shall designate the throe companies as 
X, Y, and Z. Tl\e test wfis given to the usual routine oflice clerks 
of company X and Y, the only difference being that women clerks 
wore the siibjcct.s in coiiipnny X, while men clerks in company Y, 
In the case of company Z office boys only wei-e examined. In each 
ensG Lliore has hGcii fouiul to exist n definite relationship between 
the mental alertness oC employees, as determined by lest scores, 
ami labor Uirnovor. However, this relationship is not always the 
same for tlie three companies. 

For cojn])any X, it has been foand that about *10 per cent of 
the women clerk.s hired who have an alertness score between 16 
and 30 leave within .six months; this percentage decreasing rapidly 
with the increase in the lost scores, until the least labor turnover 
is found among clerks who scored between 35 and 50. For those 
whose scorea were above 50, the percentage leaving increnses rather 
rapidly until we reach those scoring highest, where the instability is 
the greatest, greater than for the clerks scoring low in the mental 
KlertiiGss.’ From the above relationship of mental alertness and 
turnover wc may infer that company X does not give dno weight 
to the necessity of rapid promotion for its most alert clerks. 

For company Y, a.*? in the above case of company X, the labor 
turnover is high for eniployee.s making low scores; instability rises 
with an u]iward trend of the nloi'tncss scores until the highest 
scoro.^ are I'oached, where there is found a projiounced increase 
in instability, n condition unlike that of company X. That differ¬ 
ence between the two companies appeared, at the time, to be due 
to a ])cculinr wage situation causing in-stability among the middle- 
high cmplayee.s,” Thai points again to our original contention re¬ 
garding the cause of high labor turnover, that complete generaliza¬ 
tion is impos.siblo when the phenomenon is studied in the light of 
only one i.solated factor. 'VVhnt enn be said, however, is that it is not 
true that the '‘make shift” or the “general run'' of employees 
is responsible for the high labor turnover, but among other 
factors the incompatibility of the requirements of the job with the 
capacity for mental alertnes.s as manifested by the worker, is an 
impoi’tant contributing cause—and perhaps, at times, the only 
cause for labor turnover. That becomes of further significance 
with tlie multiplication of our experiments, such as the following 
one, made in company Z. 

In company 2 in February, 1920, one hundred and eleven boys 
under eighteen yours of age wei*o given the mental alertness tests, 
The results were filed away and no uae was made of them until No- 

"Hcult ^Cciniimiiy l.iilionilory lliillflln L- No. '2. Mnrcli 'io, '0-0. 
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vembei', 1921, when the scores wore brought out of the filca and com¬ 
pared with the progress made by the ])oys during tlm intervening 
twenty-one months. It lias been found that the average score 
for the one hundred and eleven boys was 08 .7, while the score 
for the sixty-three boys, .still in the eominuiy’s employ, was 41,6, 
and the average score of those no longer with the company was 
35 . 1 . That the hoys inn'king n high score are mobl likely to re¬ 
main with the company becomes evident from the above figures; 
while the boys leaving the company'.^ employ did .so for throe 
reasons; first, for better positions—their average score was 44.'i 
(notice that the score is higher than that of the hoy.s remaining in 
the employ of the company); second, to return to school; third, 
lischai'ged by the company—their average score was 

If we should compare the salary of the boy.s on November 1921. 
with the alertness .scores we find the following relntion.ship: 
Number of boys, Average alertness score. Average Snlnry. 

10 67,3 916,00 

10 23,1 913,40 

It has also been found that the average score. Cor the twenty- 
nine boys who were promoted to junior clericship wa.s 46.2, while 
the score 36.1 represeiiLs the average score of the thirty-four boys 
who have recoivod no such promotion, 

It is not only intcre.sLing but it is of importance industrially 
to notice that the boys who scored relatively high in the test 
either continued in the employ of company Z or left for better 
positions, Almost all promotion and, therefore, higher rate of 
pay were won by the boys taken from the same class, oven though 
the alertness scores wore unknown to anyone save the indu.strial 
relations department. 

It seema to iis fchnt, while the results from the above experiment 
are too scanty to permit any positive gencrnlizatlon.s, nevertheless 
they are sugge.sLive of what might bo done. Conseciuently, wc may 
venture to make the following suggestions; first, that further 
study in this field might determine the relative alertness scores 
which are most suitable for some of the industrial occupations— 
where alertness has been found to be one important factor; second, 
that knowledge so gained will be of practical iniportnnce to the 
employment mnnnger; third, that with thi.s knowledge in the hands 
of the employment manager, he will be able not only to reduce 
labor turnover, where previously the instability was mainly clue to 
the incompatability of mental alertness with the rcsponsiblity of 
the occupation, but, also, he will be able to detect individuals of 
high alertness capacity whose services to the indu.sLry will be in 
their ability to learn rapidly and in thiiL way gain quick promotion, 
ending finally with a job, the demands of which will be propor- 



LAHOU 'J’UUNOVKR AND MENTAL ALERTNESS 290 

tioniil to llio ^vorkcr's ftbilily. TIiq third suggestion expresses nn 
I'denl aitufition which we ni«y put in the sky, as Plato did with 
his ideal state, 
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HEALTH FELLOWSHIPS AND SCHOLARSHIPS 


The Ainei’icflii Cliild HoaUli Association, believiiiR' that health 
is a matter of sound education, and that no ffroatcr creed can 
he spread tlirough the world tluin the gosped of good health, has 
instituted an unique series of liealLh scholarships. 

The sum of §10,000 has been allotted to these scliolnrsbip.s and 
fellowships, wliich are to be given tenchors in service who hove 
been especially successful in teaching licnlth. The money will 
be distributed in five §1,000 scholarships and fellowships, to 
college graduates now in service as principals or eleinentni’y 
school supervisors; five §500 scholarships to normal school gradu¬ 
ates or college graduates now engaged in classroom teacliing; and 
fifteen $200 scholarships to holders of teacher's certificates now 
engaged in classroom teaching. 

Those sums are not hard and fast ones, the Committee announces, 
but approximate, depending upon circumstances. IL al.so announces 
that although the conditions require the toiiclioi- to bo in service 
at present, an exception to this rule may be mucle in favor of any 
teacher who has already done exceptional work in health educa¬ 
tion, even if she is not engaged in teaching at present. 

The purpose of these scholarships and fellowships i.s to improve 
professional training, to enable teachers to do more ofToctive work 
in health education. 

Fellowship and scholarships shall be awarded to icachers in 
scr'Oice and to teachers not now in active service but wlm luive had 
exceptionally succc.ssful experience in health education, who pre¬ 
sent evidence of some of the following qualifications: 

a. Success in teaching. 

b. Pleasing and favorable personality. 

c. Good personal health. 

d. Demonstration of unusual interest in health education. 

e. Possession of initiative, originality, leadership and ovgania- 
ing ability. 

f. In addition to the above, a good scientific background is 
considered of special value, in particular, instruction in biology, 
bacteriology, chemistry, nutrition, personal hygene, public health, 
child hygiene, school hygiene, child psychology and principles of 
teaching. 

The qualifications of the Institutions in which fellowships and 
scholarships are to be placed should include the following: 

1. Recognition of standards for the promotion of the personal 
health of their own students, 
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2. A lioiilLhful onviroiiment in Ihc institution for tho setting up 
of desirnblo stjimlnrds from the standpoint of sanitation, etc. 

3. A supplfinontary course of coordinated subjects of instruc¬ 
tion such as bioJofe'-y, nutrition, etc., in addition to the more specific 
training in healtli eduention. 

4. Opiiortunities for observation, proiiaration of programs, prac¬ 
tical toaching in health education. 

T). The providing of training for teachers in other fields than' 
the field of hciilLh education. 

0. A spirit of co-operation among the various departments 
conneetdJ witli health education, ns evidenced by their success in' 
co-ordinating the various elements contributing to health education. 

Fellow.ships and scholarships providing for a year’s study shall 
go into efi’ect with the beginning of the school year or in the fall 
of 1923. 

Summer School, Chautauqua and Travelling Scholarships will 
go into olTecL during the summer of 1923. 

The fundamental subject matter in any student’s course should' 
be derived from the following fields: Personal Hygine, Nutrition,. 
Community Hygiene, Social Hygiene, Mental Hygiene, Health and' 
care of infant.s and young children and adolescense. First aid and' 
safety, Hygiene of the wnrkci’, Home nui’sing and care of the sick, 
School Hygiene, P.sy.sical Education, Principles of Health Educa¬ 
tion and Practice Teaching- Practice Teaching to include practice 
in all types of contact with childi*en incident to health work in 
the school. 

For information address American Child flealth Association, 
370 7th Avenue, Now York City. 

BETTER EYE SIGHT AS A NATIONAL ASSET 

The Eye Sight Conservation Council of America represents a 
distinct and organized phase of the general tendency towards 
social, economic and physical betterment. It aims to bring about, 
improved vision among' the masses of the nation, experience in 
education and industry having shown that a long train of ills, 
involving grave consequences, follow in the wake of defective eye 
sight. 

One of the conspicuous services performed by the Council was. 
its participation in the nationwide assay of waste conducted by 
Her-bert Hoover as chairman of the Committee on Elimination of 
Waste in Industry of the Federated American Engineering So¬ 
cieties, This committee, whose field activities were directed by 
Mr. Wallace, found tliat heavy annual economic and physical losses 
were occurring in American industry through poor vision of the 
workers. All this, for the most part, was eharacterizecl as avoid¬ 
able waste, which the Eye Sight Conservation Council has under- 
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tflkeii to wipe out by a thorough atid systematic plan of odiication, 

Of the 24,000,000 Echool children in the United States, approxi¬ 
mately 10,000,000 cfin justly claim that their coiiiUi’y in not giving 
them a square deal, according to Prof. Wood of Columbia, “For," 
he says, "Lbcy are laborme under ti grave hancUenp—eye (leEccts— 
whicli could be mitigated to a gi'ciit extent,,if not corrected en¬ 
tirely, by the intelligent supervision of the stale m\ of the teachers 
af the nation, through proper oye tests of all pupils." IloLnrda- 
tion ia another evil caused in part, at least, by imperfect .sight. 

Experiments to determine the true economic value of perfect 
vision will be made. It is proposed to measure the improvement 
in health, increase in quality and quantity of production, advance- 
nienb of individual performance, and decrease in losses due to 
waste and accident, Factory, home and seljool lightiiig, now a 
subject of scientific research here and abroad, will be studied. 

The Council, through its Field Secretary, Charlc.s F. SouLhard, 
is prosecuting its work in the schools of many cities, This work 
embraces leelures to parents, teachers and pupils with motion 
picture illustrations, 

Co-operation with educational authorities is the prime purpose 
of the Council, An illustration of this co-operation is found in 
New York City, where the Council participated in the observance 
of HealLh Day in the schools, when the eyes of more than 1,000,000 
pupils were tested. 

Wherever the Council works, it strives to establish the jn'inci- 
pics of continued supervi.sion of the children, moLhevs co-operating 
with the teachers in identifying defects, often hidden, and in 
applying corrective measures. 
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J, W. W, Waixin. Cnnsutivc Fucloyn in HJcntal In/eviority and 
the Prevention of !}c(jencrctc]j. Miuini University, 1922, 48 pp. 

The writer Rives ii brief account of the factors causing mental 
inferiority. The article is a summery of hia study of the personal 
nncl family hislorie.s o£ H72 clinic cases. The individuals studied 
are public .school cu.soa ami not in.sLiUitional or ho.spital cases, conse¬ 
quently the wnclusiotia cainiot he affected by hereditary cases as ia so 
truly applied to iuHtitutionul case.s, After u thorough discussion 
of pcraonal and family iiialory data and with many carefully 
worked out Liihlos, the author has drawn the conclusions that in¬ 
ebriety ocenrs more frctiuoilly thnn any otl)oi’ factor. He also 
makes a statement Llml the same thing applies to immorality. He 
suiiiniarizcfl other cases of mciitiil delieiuucy^^ such as head injury, 
cerebro-spinol moningitis, infantile paralysis, epilepsy, etc., but 
finds few cases as a result of them. 

Dr. Wallin givo.s n vahmblo .sinninary of opinions amojig experts, 
as to the (logroo of heredity ninong' feeble-inindedness, Ilia study 
shows that they are quite divergent in their beliefs. It seems 
that the "facts are not yet nil in/' and that the causation of 
(eeble-mindedncas is as coinpiax as its conditions. It seems that 
from study (that) wo cannot depend solely upon colonization, 
stci-jlization and inarriago laws for the reduction of feeble-minded- 
ness, but wc must also pt'cvcht toxication of the parents as Chat 
is a big factor In injuring the young child. 

Ohio University M, La Vinia Warnsr, 

J. W. W, Walun. All InvQatiyttf'ion of the Sex Relationahip, 
MarrUii/e, Delivgncnoy itiid Ti'iiancy of Children Aaeigned to 
Speml Publio School Clttsaoa. Miami University, 1D22, pp. 34. 

This article is a summary of a final report to the Board of 
Education q£ the St. Louis Public Schools. After seven years of 
examining children for Special Education, Dr. Wallin concludes, 
that the Board of Education would have to make provisions for 
more montnlly defective boys than for mentally defective girls. 
He does not give any reasons for this. He found among the 
Special Class enrollment nii average of 2.14 per cent per family and 
a per cent of 3.3 of all the children enrolled in Special Education 
to have a record of delinquency. Ho makes a valuable discovery 
relating to the criminality and vicousness of the feeble-minded, His 
discoveries are contrary to previous beliefs in this matter. Dr. 
Wallin suggests that the Special Class training given these children 
has corrected this anti-social conduct. The same thing is true 
of truancy. Dr, Wallin found only 4.6 per cent of the total 
enrollment of the children in Special Education to be rated 
as truants. The entire article is well-rounded argument in favor 
of Special Education. 

Dv. Wallin gives a further study of the industrial records of 
children in Public School Special Classes for mental defectives 
and finds that the records both industrial and criminal so far as 
they go are quite satisfactory and point to the value of Special 
Education. However, a study of the occupations _ entered show 
that the Special Schools have given very little specific training m 
preparation for them anti the employment records of these children 
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iui;T\ish Uttk evidence as to the type of vocational training which 
should be supplied in the Special Schools. 

The remainder of the article is taken up in a discussion of the 
Legislative Act in the inteve.st of Special Education for the State 
•of Missouri. 

Ohio University M. La Vinna Warner. 

Strong and Uhrbrock. Job A7ml?/.'?is und The Curricuhtm. 
Personnel Research Series. William.s and Wilkin.s Company. Balti¬ 
more, 1923. Pp. I'lG. Price $1-00 paper, 52.00 cloth. 

There is no doubt that what wc need chiefly in our attempt to 
apply psychology to industrial management, is a large mass of 
ordered material collected as n result of an actual study from field 
experiment in problem.s of industrial management. Be it problems 
of employment, fatigue or that of incentive, the important thing 
is not so’much the ideal conditions as the creation of the possibil¬ 
ity for experiment and in that way learn, in the long run, what 
can be done in order to reach some worlcable scheme of human re¬ 
lations in this or that particular industry, Such studies have 
been published by Link, Chapman, Myers Scott Company, Carnegie 
institute of Technology and others—to our delight a new study of 
an important industrial problem by Strong and Uhrbrock has 
just appeared. 

Messrs. Strong and Uhrbrock set before Lhomsolve.s the task of 
the actual field study of the functions of the executives 
in the commercial printing industry. ^ This survey “was 
mncle for the express purpose of inventorying tlie du¬ 
ties of executives and discovering where the emphasis should 
be placed in training men for similar positions" (p, 71.) “Not 
only was it worth while to secure more comprehensive information 
upon which to decide difTerence-s of opinion between the printing 
department faculty Carnegie Institute of Technology and printing 
exeutives, but also in order to decide dilTerences of opinion be¬ 
tween the faculty in the printing department and other departments 
in the Carnegie institute" (p. 71.) To supply material from which 
a well balanced and proper curriculm could be developed and or¬ 
ganized the authors set before themselves the task of making a 
comprehensive study of the various executive jobs within the 
printing industry—the first task was to make a job analysis and 
from that to develop the job specification. These would naturally 
supply the information necessary for the empirical curriculm 
making. 

The present study, however, is more than an attempt to record 
•the results of the above stated survey; as a matter of fact it is 
also an attempt to define the meaning of such an experimental 
attempt'and to state the technique of obtaining the necessary data 
and result. Consequently we find in the book chapters dealing with 
such subjects as the following: job analysis, job specification, the 
construction of a curriculm baaed on job analysis, and a bibliog¬ 
raphy of job analysis material. 

Some “industrial psychologists’’’ ai’e coming to the conclusion that 
a job analysis, made for the purpose of deriving a job specifica¬ 
tion—to be used by the employment and training department and 
by the woge committee—should contain a study of the actual func¬ 
tions of a job rather than of a time and motion analysis of the 
worker. This latter type of job analysis has its value, but in a 
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lilToveiit renlm, which is very important—in a study of eHicient 
voi'king methods. A job analysis is pei’haps not the best name 
jecause of its traditional connotation to desig-nate a study of the 
liffevent functions performed by any ffiven worlcer. Such study 
nay perhaps be best designated by the name “occupational de- 
jcriplion.” This name seem.<) to us to be more descriptive of the 
nature and content of such n study. The authors define a job 
analysis to be “a inelhod of scicnli/icnlty dissecting a job in order 
to determine the component elements and their iniluence upon the 
length of lenrning period of the worlcer, production and labor 
turnover” (p. 22.) This definitinn wo fear is too broad; it covers 
more than the type of study made by the authors; it includes, it 
seems to us, even the most minute analysis of the worker's time 
and motion, and of the method of handling himself, tool.s and raw 
material, 

A job specification, the authors say, is the records of results 
obtained from the job analysis (p. 23.) “The job analysis is the 
means; the spccificntion is the end” (i). 24.) “Today the most sat¬ 
isfactory job specification is one that lists the specific duties in out¬ 
line form and contains a complete analysis of duties, man re¬ 
quirements, working conditions, essential education and promo¬ 
tional possibilities’' (p. 27.) While in the actual study itself—and 
to our admiration—the authors kept clearly in mind the different 
aims of a job analysis and those of a job specification in their 
theoretical statements, as above quoted, we must confess the dif¬ 
ference is not clearly stated, if not really confused; for example, 
the statement that a “satisfactory job specilicntion is one that 
Hats the specific duties in outline form and contains a complete 
analysis of duties. “Is that not a part of job analysis or are the 
nature and content of a job analysis and of a job specification 
the same? Or is the dificrence only that of function? 

The content of the book is a valuable contribution to the much 
needed experiDiental work in personnel problems. Not only the 
authors and the psychologists in the Carnegie Institute of Tech¬ 
nology but also the editors of the Personnel Research Series should 
be commended for the type of work that they all made possible 
to appear. It is only to be regretted that more of such studies 
have not appeared up-to-date but we look wilb confidence to the 
future. 

Northwestern University A, J. Snow. 

Edwin A. Shaw and Edward A. Lincoln. A Compa}‘iso}i of 
ihc Intelligence and Training of School Children in a Massachu¬ 
setts Town. Harvard Monographs in Education, Number 1. Cam¬ 
bridge, Mass. The Graduate School of Education, Harvard Uni¬ 
versity. 1922. 

We have in this monograph a report of two surveys of the 
schools of a small town. Group tests of intelligence and edu¬ 
cational tests in arithmetic, writing and reading were given in 1921 
and again one year later, The study emphasizes the importance 
of the interpretation of survey results by the teachers and officers 
themselves. It is upon them then that the duty of providing 
remedial measures rests. The reports which are not effective in 
practice in the systems where the data are gathered fail of tbeir 
main purpose. The authors also caution against over-emphasia of 
.the formal processes which standard tests now measure; and the 
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opinion is expressed that most standards are too hifih for practicul 
purposes thus causing a sacrifice of the less easily nieusuvable to 
the more easily measurable results. 

Walter F. Dearborn, Edward A. Lincoln and Edwin A. Shaw. 
SUoidard Ediicaimml Tests in the Elementary Ti-aininy Schools 
0 / Missouri. Harvard Monographs in Education, Number 3. Cam¬ 
bridge, Maas. The Graduate School of Education, Hiirvard Uni¬ 
versity. 1922. 

This monograph gives the detailed results, with some comment 
thereon, of the educational tests which were given in the investi¬ 
gation of teacher-training in Missouri. A general sunnnavy of the 
results has already been published in "The rrofessional Trepar- 
ation of Teachers for American Schools" issued by the Carnegie 
Foundation. It seems strange that in this university monograph 
the name "Cape Girardeau" should be almo.st consistently mis¬ 
spelled. 

Ohio University II- G- Good. 

A. B. Eitt. The Hitman Instincts in Business. The Lothian 
Boole Publishing Company, Melbourne and Sydney, 1922. Pp. VIII 
and 100. 

The author of this book does not claim to have made any new 
contribution to our knowledge of instincts; he has attemplecl only 
to point out in what way our knowledge of liuman iiaturc—in the 
major part our knowledge of instincts—can be of value in solving 
the problem of industrial relations, and that seems to be mainly n 
problem of incentives. The "book is an outline of some of the 
mnin features of a series of lectures delivered in 1918 to a body 
of men and women I'epresentative of the Melbourne bu.siness 
world" (p. VIII). 

Professor Fitt in his attempt to throw some light upon the dilh- 
cult industrial problem shows a pretty thoroughgoing influence of 
Professor McDoiignl—^while hia application of Profos.sor Mc- 
Dougal’s general theory of instinct is clear it lacks the brilliancy 
of Professor Watts' treatment in his Introduction to the Psycko- 
loyical Problems of Industry. One is familiar with such an at¬ 
tempt i. e,, aa started in the United States by Professor Parker 
and followed with last mastei*y by Mr. Tead; in England by Pro¬ 
fessor Watts. Neither Mr. Tead’s nor Professor Pitt's books are 
of great value as proposed solutions of the problem of economic 
motives—their worth lies in n different direction. Mr, Tead’s 
vivid examples of industrial maladjustment are useful as a source 
of cases; while Professor Fitt's application of instincts to the gen¬ 
eral problem of economic motives is suggestive. Both, however, 
suffer because of a lack of method of approach to tlie problem. It 
seems to us that the only method is an empirical one and no other. 
The tendency today is to base too many deductions and generaliza¬ 
tions of wide economic application on our hypothetical knowledge 
of instincts, It is a pity that we should spend so much of our 
energy in riationnlization. If we had knowledge of social behavior 
which was derived from experimentation or observation of n very 
large number of social phenomena then with caution we might 
apply such knowledge to our general problem of economic motives, 
but as the ca.se is our present social psychology is the most hypo¬ 
thetical branch of the science and therefore such n procedure is at 
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best only isuRKCstive unci at times—if taken sei-iougly—dangerous. 
What we might do, however, is to collect a largo number of cases 
and from thoKc, if possible, infer certain hypothesis, and further 
by their application—social and economic experiments—come 
closer to n true Iciiowledge of tlie.su complex human motives. If not, 
the ro.sult of .siicli a .set of lectures as these by Professor Pitt will 
produce comineiits .sucli an the oriu stated In the introduction by the 
spoti.sor of tlu! .sericK.’ “while the hearer could not say that he had 
gained anything that he coiihl directly apply in his business, he 
found that liis point of view lind been changed” (p, VII), 

Just a.H Mr. Teud’.s fmlincCH in (ndnsiry so Professor Pitt's book 
TIlc /IiDiian hiniinctu in fluHinesii suggests—even though uncon¬ 
sciously, I presutue, because such a point of view is impossible— 
that instincts as luotive.s operate one at a time or if in groups as 
independent units and naturally we find the customary list of 
cliapter.s, of wliicli tlie following are some examples: “Tlie Gre- 
gariau.s Iiustinct," “SuggG.stioii niid Imitation,” “Self-di.7play, Pug¬ 
nacity, Contra-Kiigge.stion, Emulation,” “The Collecting, Acquiring, 
or Hoarding In.stiiict,” “The Instinct of Self-abasement in Relation 
to Se)f-a.H.Hertion.” The following will serve as a specific illustra¬ 
tion of the .'luthor’.s apidication of the supposed knowledge of in- 
stinct.s to « jmrticular problem of. industrial management: “Pay¬ 
ment by piuoL* rale is Lho method employotl in very many factories 
(in .some coiintrie.y imhistrial legislation will not allow it), and- 
there ciin be no doubt that it gives the most direct apijroacl) to the 
original nntnru of tlie instinct. For each separate stroke or eifort, 
for each unit of work completed, there is a separate unit in pay¬ 
ment. The reward stands in direct proportion to the work done, 
The vorioua other method.s of task-payment increase the pay with 
incresisu.s in tho amount of work done, but the increase is not di¬ 
rectly in-oporLionnl. Still the a])peal is greater than that of the 
fixed wage, which does not present the continual draw or stimulus 
to elTort.” 

“Again, once the rhythmic activity from effort to reward, re¬ 
ward to further effort is set up, it can be kept going to almost any 
extent, ju.st a.s tho squirrel or hamster adds to its store long after 
the winter’s needs have been satisfied. Thus, subject to the limits 
of human capacity, the appeal to effort of the task-payment sys¬ 
tems never ceases" (pp. 64-05). Here the author forgets the great 
dangers of a “piece rate system" upon the general health and effi¬ 
ciency of the worker; the nervous strain upon the slower employee 
and, what is more, the actual experimental proof that the use of 
wages ns an incentive in rather limited. 

It is interesting to note, however, that the British psychologists 
more than the American—in the United States, however, a group 
of brilliant younger economists—have attempted to throw some 
light upon the much vexed problem of economic incentive—a prob¬ 
lem so disturbing to all students of industrial personnel. 

Northwestern University. A. J. Snow. 

Universili/ of Iowa St2i(Ue3 In Fsychology, No. VIII, Edited by 
C/ii’l E. Seashore. P.sychologica! Review Co., Princeton, N. J,, 
1922, Pp. IV, 382. Price (?) 

This collection of monographs represents a somewhat extended 
scries of studies in .sound localization, the psychology of music, 
and muscular reaction, It will bo impo.ssible Lo review all the 17 
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articles iei any thoronKhRoinf? way Ivecnusc o[ tlioiv vavinbilily of 
subject matter, aiul variety of trchnitiiie, since nine of the articles 
are doctors' tlieses. 

The first three nrticlcs by Scjisbore, Halverson, and Stewart, 
resiioctivGly, deal with the wavo-i)hase localization of sounds. Sen- 
shore sketches the proRross made in the subject proviou.s to the 
World War; lialvorson presents a muss of observed data on the 
subject, but sets forth no conehisioiis; while Hlewai’t, iijiproacliiiiR 
the problem from the stiiiidpoinl of physics, i-eacbes the conclusion 
that the phase effect is not wboUy due to viiryi^iR iuU'usily-ratios 
but that the organs of hearing respond to the pliinsu as such. 

The next eight article.^ deal with tlie psychology of music, The.se 
are more or loss condensed doctors’ Iheses. launch inve.stignled 
the acuity of hearing througliout the tonal rniigo. lie reviews the 
in'evioii.s work done in this licld, describes the Iowa IMtcIi Range 
Audiometer which he perfected, and presents data to show wherein 
his instrument permits a much more clfeclive means of dcLocting 
various types of defects of the internal ear than any insLriiment.s 
in previous use, Zuohl's thesis describes a still further develop¬ 
ment of the instrument described by Hunch. lie also establLslies 
norms of auditory acuity ba.scd upon ages of 0 io 15, 17 to 41, and 
42 to 7;3 years, in which somo very interesLiug facts with regard 
to pitch acuity for high tones is shown. Ziictil iiresenls a very 
brief article descnbmg a stroboscopic device for measuring revo¬ 
lution 1 'aLe.s, AvS a piece of laboratory G([iiipincnt Lhi.s apparatus 
meets a didiciill situation lit rcasoniiblc cost. Knock has invc.sti- 
gatecl a means of training the voice by the aid of the eye. Ilis 
mea.sui'cmonts arc made with the tonoseopc, the stanclanl 25(5 fork, 
and the ICoenig re.sonator. His siibjeels sang a standard tone, its 
major third, its fifth, and the octttvc. His results agree with pre¬ 
vious work in tluiL the major third, the fifth, and the octave are 
found to be of about c({ual dilHcnUy in .ringing. TOrror.s in singing 
tcncl to a daily similarity. It is found that one can judge the ])iLch 
find inaccin'acie.s of another voice better than of his own. Gaw 
applies the principle of vocationul guidance to scIiooI.h of nausic. 
Her data colleeted from students in music at NorLlnvesLcwi Univer¬ 
sity shows clearly by graphic representation of individual cliar- 
acteviatics that musical surveys, thoroughly made, are of groat 
value in advising students who cicsix'e a inusienl education. Stnn- 
loii’s study of inheritance of specific nm.sicnl capacities prc.sents 
family histories, and a series of musical talent pedigree charts 
which lead her to the conclusion that musical talent i.s probably 
inherited according to Mendelian laws. Merry's article describes 
a method of graphicully recording all the speech inflections of the 
human voice. A detailed description of the apparatius, including 
an inustration, is given alongside sample charL.s and graphs. 
Schoen's article is a study of the unconscious modifications of the 
singer’s voice while attempting to sing a musical melody. Especial 
attention is given the vibrato. He concludes that tone.s arc usually 
attacked at a pitch lower than intended when preceded by a lower 
tone, and that they are released at a pitch higher than intended: 
that tones are rarely sustained their full interval; that two tones 
are seldom sung alike even by the same indivklunl that certain 
vowels arc inherently higher than olher.s; and that the emotion 
expressed by the vibrato ib made possible because wc have so fre¬ 
quently associated tremor with emotion in past experience. Wick- 
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ham's ai’ticlc is only a preliminary study in the control of intensity 
of Houinls by touch. Apnew presents two articles in which she 
attempt''* conipnro the auditory imagery of musicians, psychol¬ 
ogists, iind children. She uses the questionnaire method and finds 
that iniisiciunH gcinernlly attribute themselves with an auditory 
imagery whicli develops with training; Psychologists are more crit¬ 
ical and believe that their inusica) images are more Idnaesthetic 
than JUidit(iry; and children nml untrained adults allege a very 
decided auditory imagery of sounds. Her study of great composers 
shows that they invariably possessed a vivid auditory imagery, but 
this WHS usually HUpportfcl by strong imagery in other fields. 

The ifkst Llki’ce articles arc sltidies In motor capacities. Tlio first, 
by Mi.'j.s Koerth, de.scribcH n pursuit apparatus designed to study 
eye hand coordinations. A phonograph disc, with stylus, magnets, 
counLev, etc., compo.se the apparatus. Ream’s article auinmarizcs 
previous work with a tupping test, and describes a new technique 
for tlii.s much used experiment. Hensen’s article is a study of 
serial action. Ilis apparatus consists of a commutator attached to 
a typewriter in such a way that any one of four circuits may be 
closed. lUs .subjects wei*c students, army recruits, musicians, and 
BtenoRTnphoi'S. Ho finds a decided personal equation in speed, no 
consistent relationship betwcon speed and accuracy, some corrola- 
tion with oLhor motor teats, and slight positive correlation with 
other motor tests, and slight positive correlation with intelligence 
LgbL.s aiui ability to read music at sight. 

Ohio University. C. 11. Growdon. 
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EXPERIMENTS ON ROD-DIVINING 


By William S. Fosteh 
University of Minnesota 


Some months ago the pastor of a church in a neighboring town, 
a man about 70 years of age, called at the Psychological Labora¬ 
tory of the University of Minnesota and asked that experiments 
be conducted to measure, and if possible to explain, his apparent 
powers in locating materials by means of divining-rods. 

He gave an account covering 45 years of successful location, 
not only of water but of oil, natural gas, iron, gold and silver 
in Wisconsin, Minnesota, West Virginia and Texas, and he pre¬ 
sented documentary statements by engineers and others who had 
witnessed his successes, amply sulheient in amount and respecta¬ 
bility to Warrant the belief that his powers are typical, and at 
least as groat and as convincing to observers as are those of 
diviners in general. His utter sincerity was manifest not only 
by his profession and by his action in seeking scientific test and 
explanation, but also through the fact that he agreed without 
reserve that the time and all other conditions of experimentation 
should be determined by us, and that publication should be allowed, 
whatever the favorable or unfavorable outcome of results. Further 
evidence appears in the account below. 

The experiments were conducted in and about the Psycho¬ 
logical Laboratory during the morning and afternoon of March 
26, 1923. The writer was assisted by Professors R. M. Elliott 
and D. G. Paterson. 

TEST 1, DIVINATION OF LOCALITY 

The diviner reported previous uniform success in locating hidden 
coins end watches, and our first experiment is intended to test this 
ability. "Neutral ground” was discovered in the main laboratory 
and a large table moved upon it. The table top was then chalked 
in 14 squares, each 20 x 20 inches. The center of each square was 
numbered visibly, beginning with numbers 1 and 2 at the left end 
and continuing with odd numbers on one side and even numbers on 
the other. The floor directly under the table was marked in squares 
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exactly Lo con-DSpond to tlic top, and the Hoot and space beneath 
^ve^•e Rhiclded from sight by cardboard screens. 

Tile rod used was n piece of fairly stiff piano wire bent in tho 
shape of a small written "e". It was therefore .smaller and more 
flexible and smooth than the Y of sapling often chosen. The "e” 
shaped loop in the wire was appvoximi\tcly 2 inches long and the 
ends, which were held Iietween tho fiiiKcrs in a common divining 
position, were each about H'/j inches in length. 

Silver coins, a silver watch iiiul 2 gold wntche.s were placed in 
a .small cardboard box. An experimenter first placed tlii.s box upon 
tho lloor in the center of n sciuave chosen by the diviner. When 
the diviner stepped upon the corresponding square of the tabic 
top the rod rotated deJinitcly and strongly, When he stood in 
any other square he perceived not even a tendency to rotation. 

A random series of trials was then made, Their order was 
known only to the cxpcvimcntcv who did the placing. Before each 
trial this experimenter left the room. The diviner was then 
brought in by a second experimenter, mounted tlie table, and 
walked slowly over the squares until the rod rotated. In each 
trial he then coiitinned exploring without indication over all the 
non-cvilical squares in order, and finally "double checked" his 
first location. No hesitation was manifested at any time, and 
often the diviner carried or a conversation ns he explored. 

The second experimenter recorded the estimntes, which always 
fell in the center of some square. Thirty-two trials wore made, 
the box boiug placed twice in the center of each of tl-i« 14 squares, 
and at intervals (without the diviner's knowledge of such in¬ 
tention) d trials wore made in which the box was not placed at 
.ail, but removed entirely from the room. 

In all of these four latter trials indications were obtained ex¬ 
actly as usual, squares 13, 3, 1 and 5 being designated. In the 
U'emaining twenty-eight trials the correct square was indicated 
■once only, whereas two correct judgments arc likely to be given 
by chance alone, 

Considering the two "sides” cf the table merely (i.e., odd num¬ 
bered versus even numbered sq lares) the side was correctly in¬ 
dicated in 57% of trials and ^he wrong side in 43%, whereas 
607° of correct judgments are nmst likely by chance alone. But 
if we consider the accuracy in judgments of '‘end" (i.e., first 7 
versus last 7 squares; and flr&t six plus square No. 8 versus 
first six plus square No. 7) the outcome i.s more than equally un¬ 
favorable; 37% right versus 63% wi’ong. 

A consideration of the amount of error maao in location verifies 
the judgment that successful locations were imthev fewer than 
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chance would indicate. The average error which would most 
likely occur by chance is approximately 50 inches. The actual 
errors average 54 inches. Another fair <but possibly unreliable) 
method of judging accuracy is by a “pseudo-correlation” between 
the square-numbers reported and the numbers given. By rank differ¬ 
ences the "correlation" so obtained is -.22. A rank-differences 
correlation which considers merely the seven cross-table oblongs 
of two squares each comes out -.13. 

We must conclude that under such rigidly controlled conditions 
no power of accurate location whatever is indicated. The as¬ 
surance and lack of hesitation with which such faulty locations 
were made by the diviner in the apparently total absence of cues 
are truly astonishing, but our observation furnished no basis for 
even a guess at explanation, 

TEST 2. DIVINATION OP AMOUNT OP MATERIALS 

Neither the diviner nor any experimenter was permitted to 
know the actual results of the first test, but a second test was 
begun nt once. In preliminary trials (made with knowledge on 
his part concerning the amounts of material placed in the box) 
the diviner showed that with no materials, the rod did not move; 
with only the coins, the rod moved wealtly and slowly; with the 
addition of one watch it moved perceptibly more strongly and 
faster; with still another watch yet more; and with another 
watch added, very perceptibly more. He maintained his ability 
to discrimi-ncate with case between these steps in amount of ma¬ 
terial present, and agreed to report accordingly in an experiment 
either “nothing," “weak," "fair," strong,” or "very strong." 

The diviner stood on a square on the table top. An experi¬ 
menter sat beneath the table and placed in random order in the 
box in the center of the corresponding square on the floor either 
nothing or an indicated amount of material. Twenty-five trials 
were made; 6 with nothing, and 6 with each of the four positive 
amounts. 

The diviner judged correctly in 24% of eases, 20% being in¬ 
dicated by chance. His average error was 1.4 steps, as compared 
with the l.C steps which chance would indicate. The rank-dif¬ 
ferences correlation between actual and estimated amounts was 
-I-.20, P. E. = ±13, (Pearson coefficient = +.12), os compared 
with the .00 correlation most indicated by chance alone. 

It is impossible to say whether these relatively small differences 
from chance arc significant or not. To avoid the fatigue of con¬ 
stant mounting on the table, the diviner did not leave the room 
between trials, and the possibility exists that differences in the 
noises made in changing the amounts, in placing the box again on 
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the floor, in the tone of the experimenter's voice in calling "ready”, 
etc., may have served quite "unintentionBlly” or "uuconaciously” 
as cues which slightly favored correct judgments. 

TEST 3. DIVINATION OF DEPTH 

As an indicator of depth, the dinner used a heavy straight 
wire rod about 20 inches Jongp fitted with a handle and weighted 
at the outer end, This rod vibrates verticnlly a given mimber of 
times until it corresponds to the supposed depth of the material 
in feel below tho diviner's ground. The plane of vibr'ation then 
suddenly shifts to horizontal. 

“Neutral ground" was located in the hallway on the second 
floor of the luboratoi'y. In the lower hall directly beneath, q 
long step-ladder reaching from floor to celling was set up at an 
angle of approximately 70 degi’ees. The depths chosen for experi¬ 
ment were the 12 steps of this ladder and a point on the floor at 
its foot. According to mensurennents taken after the completion 
of the experiment the rise per step was approximately 11 inches, 
and the range of the thirteen depths chosen varied between ap¬ 
proximately 1.1 and 11.9 feet. 

The experimenter placed the box of materials used in test 1 at 
various depths in a random order known only to himself. Ho 
was never visible to the diviner, but noises made in climbing up 
and down and in placing the box were faintly audible via- the 
Btairways to any one in the second floor hallway where the diviner 
stood. The possibility of such auditory cues might have been 
avoided by leading the diviner from the hall between trials but 
time did not permit. The diviner and the second experimenter, who 
stood by him and recorded his estimates, knew nothing of the 
actual depth-positions used save that they varied by steps be¬ 
tween the two floors. 

Twenty-six trials were taken in random order, each of the 13 
depth positions being twice used. In each trial the diviner used 
first the location rod and then the depth-rod described above. He 
then gave verbal reports. Estimates such as "between 7 and 8 
feet” were recorded as 7% feet. 

The estimates ranged between 3 and 16.6 feet. Seventy-seven 
per cent of trials were over-estimations, the average estimate 
being 9.6, as compared with a true average of 6,5 feet. The 
average error of estimate was 4.6 feot (in a range of about 11 
feet) and only 12% of the judgments were accurate within 1 ft. 
The rank-dilfcrences correlation between the actual depths and 
the diviner's estimates was +.29, (P. E, = .11) which even in so 
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few trials oueht perhaps to be regarded as significantly better 
than chance. 

TEST 4. DIVINATION OF DEPTH WITH INTENTIONAL 
SUGGESTION 

About two-thirds of the way up the stairways leading from the 
first to the second floor hallway mentioned in test 3 are two land¬ 
ings, from which both the step-ladder and the diviner could be 
seen. In test 4, taken in the afternoon, six spectators were allowed 
to stand and watch both the placing and the divining. In order 
clearly to sec the experimenter place the box on the upper steps 
of the ladder, spectators naturally lean forward slightly. 

The diviner was told simply that further experiments on depth- 
estimates were desired to check those of the morning, and that 
some of our graduate students and instructors who had never seen 
divining would be interested to observe it. The spectators did 
not in general know the purpose of the experiment save that a test 
of divining was being made. They were warned not to talk loudly, 
nor by smiling when estimates Avere made to give possible in¬ 
dications of neciiraey or inaccuracy. After half of the trials were 
made the spectators were told privately to try to make their ob¬ 
servation of the experimontor’s "placings” somewhat less visibly 
evident by avoiding leaning to sec the upper stops of the ladder, 
All watched Avith some interest a .series of 26 trials, which in all 
other re.spects exactly duplicated those of test 3, 

The estimates ranged between 2 and 15 feet. Only 5B%, 
instead of the 77% of test 3 were over-estimations. The 
average estimate Avns G.9, as compared Avith the former average 
of 9.B, and Avith the true average of 6.5 feet. The average error of 
estimate was reduced from 4.5 to 2,3 feet, and the percentage of 
estimates accurate within 1 foot was raised from 12 to 19. After 
the twenty-sixth trial, 6 successive additional trials, made as if in 
continuation of the series, but Avith the box of materials entirely 
removed from the hall, resulted in estimates of 2, 14, 3, 7V2 and 
3 feet, 

The fact that after test 3 the diviner had seen the experi¬ 
menter measure with a yard-stick the total height from floor to 
floor may partialis' account for the improvement in the range of 
his estimates, au. .or some of the decrease in amount of over- 
estimation and of errors, though there is no evidence to show that 
such correction was realized or knoAvingly made. Such knowledge 
of absolute distance, hoAvever, would not by itself tend to raise 
a ranfc-diffcycnces correlatioji above that obtained in test 3, since 
relative rank-order (and not absolute accuracy) is hero the deter- 
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mining factor. The correlation, however, was actually raised from 
-I-.29 to +.77, and this notable improvement in accuracy of re¬ 
lative depth accordingly appears to be due to cues obtained from 
the spectator's behavior (unconscious and involuntary movements). 

Spectators agree that external observotion of the diviner's be¬ 
havior did not at all indicate that he gave any particular or 
intentional attention to them or their acUona, When not con¬ 
versing he appeared simply to be "enbrancedly” attentive to the 
action of the rod. He himself, with every objective indication of 
sincerity, maintains that the rod simply "acts of itself”, inde¬ 
pendently of or "almost in spite of’* his volition, and he has no 
theory to account for his apparent and real .successes under less 
strictly controlled conditions in the field. 

He was entirely surprised when shown the results of the testa 
described, find maintains that his experience liacl led him to be¬ 
lieve that his estimates under our conditions would be nearly or 
quite perfect. Whtin our theory as to cues was propounded after 
experimentation, he still could not believe that such n theory can 
be applied completely or adequately to explain his previous suc¬ 
cesses, and he made no attempt to justify or to explain the re¬ 
sults here presented. 

TEST 6, THE LOCATION OF WATER-MAINS 

In order more nearly to approximate field conditions, the diviner 
was ashed to judge, through indications of location, direction, 
width and depth, the probable course of water-mains leading to 
two buildings on the Campus. An experimenter, who know the 
true locations, accompanied him and recorded the observations 
on a rough map. Light snow covered the ground in most places. 

The results obtained are difficult to descx’ibe without reproducing 
the map, but our general impression is that, as is usual in such 
cases, the diviner's judgments while by no means perfectly ac¬ 
curate or complete, were far too accurate to attribute solely to 
chance. In case of the first building the only probable course 
indicated wag near the true main, which leads 250 feet to n neigh¬ 
boring building, but it was distant about 15 feet at one end and 
about 50 feet at the other from the true course. The indicated 
depth of 11 feet is approximately the true depth. A second indi¬ 
cated course of about 100 feet at 30 feet depth was at an angle 
to a sewei-pipe leading from the rear of the building and opening 
out of sight about 60 feet down the river-lmnk. 

In the case of the second building an L-shaped course of 80 
feet nt 10 feet depth, ending at a visible hydrant was indicated 
exactly over a true main, but a second main leading to the build- 
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inff wna passed over entirely without indications. These out-of- 
door observations appear typical and in ell essential respects 
similar to numorous observations reported by Barrett' and other.?. 
Such experiments point to a judgment that under field coudilion.s, 
where surface signs and cues from the accompanying person arc 
possible, the diviner is usually more accurate than chance would 
indicate, 


SUMMARY 

A fair summary of the evidence regarding the accuracy and the 
explanation for the apparent succsses of diviners is entirely im¬ 
possible in short space.^ In general, however, the evidence appears 
to the writer to justify the following conclusions: 

1. The matter cannot be distni.ssed by saying that tlie diviner’s 
successc.s in tlio field are simply lucky or chance Iiits, hut they 
probably fur exceed the expectation of chance. 

2. Diviners are not in general cliaiiatans, but sincere believers 
in their powers. They do not in general possess accurate geo¬ 
logical knowledge, nor do they in general appear to rely greatly 
upon voluntary observation of contours and other surface signs, 
such as experience may have taught them might be significant, 
If such signs are important, as they appear to be in some cases, 
knowledge of their prccepLion and importance, and lc?ioivlodgc of 
his own reliance upon them is not in general realized by the 
diviner, 

3. In almost all “field experiment's” the diviner has been ac¬ 
companied by a “checkor” or person who possessed knowledge of 
the true locations, depths, etc., and cuts given unconsciously by 
such persona in their involuntary movements or unguarded speech 
appear to be a common basis for tlie diviners indications, even 
tliougli again the diviner may not, and usually does not, 
intejilionallu observe .such signs or realize their importance. 

4. Experiments in which the cues mentioned in 3 and 4 above 
were rigidly excluded are rare, and their results in general are 
either inconclusive or actually negative. The experiments in 
which predictions made by geologists and by diviners disagreed, 
and where wells w’eve later drilled to ascertain the facts, do not 
appear crucial, and the results are variously estimated and ex¬ 
plained by di/Terent investigators.^ Two previous e.xperiments 
under conditions soinewimt similar to our ow’n test 1 are briefly 

‘Kce I'’ A. lliivri'U, /')■()'' Kw- t’ftir'hicul UcsMixh. Vol. l.'i, ISO?, itp, 2-2.)0. 
ttiui Vol. ntiiu, i>|). 

=A Ciili'ly I'ull lillillopniiiliy If) Blvt'ii In 77ic DivSwiMg Rotl /t II>slor\i o/ 
V. S. (U'ol. sm'vcy I'lnnii'ili'l ‘H'', l'>77. 

C‘, K', W .r, Solliis: Prof, N, il.. 'J, ISSl, lip. 7:i-78, and tV. F, linrretr. 
0 / 1 . i'it., Vol. l.'j, pji. lll-Ol. 
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reported or referred to.' The resulia appear quite uniformly 
negative, since the diviners obtained approximntely the percentage 
of successes which chance would indicate. Differences in humidity 
and temperature, etc. (together with hypcrncsthesin) have been 
proposed as cues without, it appears, great warrant. In view 
of the facts that diviners appear more successful and believe 
more in their ability to locate water than metals, running rather 
than standing, and shallow rather than deep water; that phimbevs 
commonly li.sten for leaks and that everyone has noticed the 
peculiar auditory quality of the moving water current, it is 
strange that one finds on cnsuiil reading no snggesLion that ,soititd 
may be an important cue in many cases- I am told that in some 
countries putting an ear to the ground is a recognized method of 
locating underground springs or courses, Our own experiments 
certainly point to its possible and probable significance under cer¬ 
tain conditions. The p.sychologist certainly does not, at any rate 
until furUier inexplicable facts appear, need to suppose a special 
sense nor a special mystical power of "clairvoyance" or "telepathy" 
to explain wiiter-diviuing. 

5. The inovoments of the rod appear to the diviner to bo auto¬ 
matic, and often not even to be subject to his voluntary control. 
The form of the rod and the mechanic.^ of its movoment Jire .sucli 
as to favor the suggestion that it "moves o£ itself" and somi-tiinos 
moves in spite of voluntary efi’ort.'i genuinely made to restrain it." 
From unbelievers who inwardly vow in advance to hold the rod 
steady "though an ocean .shoidd ho flowing beneath their feet," 
reports are not uncommon that they do not succeed, but that the 
rod "twists the more, the more they endenvor to restrain it." 
The various forms given to the rod, the .success of some diviners 
who use no rod at all but go by "impressions" or ".sliiver”, and tlie 
facts that only a relatively small percentage of persons are "sen¬ 
sitive", that the indications appear only if the diviner is "set" 
for them, and other facts too numerous to mention, all indicate 
that the existence of a psychical automatism and the presence 
of some suggestion to touch off a recogniacd response are the only 
necessary and essential ba-ses for the "indication.^"." 

This hypothesis is all the more probable in the light of our 

•SCI' ]0. n, IV.:isi«; ]‘r/ic S. I!., 2. 1S8I, pp. 70-0J, niiil W. F. Dnrrett, 

op, I’d., Yol, w. n. iT«; vm, tri, p. 

■S I', for (‘xiimiilo, iiiniii'i-oiiK iii>(iii]oos kIvi'H liy W. I‘'. IliirroLf; op. cil., 

M, (’iilvun.s'li/i'ini'tfUiii tiiK/ d«' Vciif UlliO, IIP. 

'"Acei iii|)imyin« Llio involohliivy find iincoiisoious itni.sciilar eonU-nclinii 
'vhicli oiuiscs the moCIffi of Lie I'orktd Lwlw or mil. miuiv ilivinei'S expci'i- 
i‘iii'(‘ a )n'('iil]iir v\ii!iilm' iiinl sojiir ii rnnviilnlv<’ wimsm, * * * 'I’lio atnU; of 
monoUlclsni of I lie dmi.sor crcalrs a condll Ion of lairlliil catiilrp.sv Mdinn 
Killin' suKfn’KOiiii caiisi'.'i di" Idea In ciiliiilimlo." IIiirrctL: op, cil., Vol. 10, 
p DM, Sec iil.Kfi Xul. i;i, [ 111 . 272-277, 2-in-2.11); Vol, JO, iip, 1;J0-131, and 
i-'ls IvlUTO. 
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knowledge of the part played by hyperaesthcsia and "unconscioua 
notice” preceding or during trance, and in hypnotic recall, the 
determination of dreams, automatic writing and the like, and in 
the light of our knowledge of the importance of cues and sug¬ 
gestions often given by the knower'a unconscious and involuntary 
actions and accepted by the “aenaitive” without clear realization 
of the fact. To become convinced in the latter regard, one hag 
only to compare the conditions and results of divining with those 
of mind-reading, muscle-reading, table-turning and of thinking 
animals like Clever Hans. 



A STUDY OF THE APPROPRIATENESS OF 
TYPE FACES 


By a. T. PoPFENBETlGEft 
CotUMDiA. University 


And R. B- Franken 
New Yonic University 


In the search for perfect advertising no factor is considered of 
too slight importance to deserve careful investigation. The laws 
of human behavior as discovered by the psychologists have been 
generally called upon in order to draw away from an individual 
the control of his behavior and put it into the hands of the ad¬ 
vertiser. By far the greatest amount of consideration has been 
given to the mechanical devices for gaining und holding attention, 
nnd for making impressions permanent, The feelings, pleasantly 
niicl unpleasantly toned, nrc coining to be looked upon as forces in¬ 
fluencing reactions to advertising sufficiently to deserve study. 
Pi'cuchan psychology, with its well-known doctrine of the suppres¬ 
sion of the unpleasant, may have something to do with this spread 
of interest. However, TlolUngworth some years age showed the 
bearing of the "oblivisceuce of the disagreeable" upon adver¬ 
tising, and pointed out that advertisements to be most effective 
should be pleasantly toned. No labor or expense is spared on the 
makeup of an advertisement and especially in color and nrL worlc. 
in order to make it pleasing, Much of this elaborate use of ar¬ 
tistic material is sometimes criticized on the ground of lack of 
appropriateness, for after all is said, it is the appropriateness 
of the presentation that determines whether or not the total effect 
shall be pleasing. 

Typography has long been believed to be a source of mildly 
pleasant or unpleasant feeling tone, occording to its character 
and appropriateness, and this belief has influenced the choice of 
type in advertising. The accompanying cut (Fig, 1) will illustrate 
the differences in the type faces used for various Icinds of com¬ 
modities. In the case of "DissLon" and "Speed-grits" the type very 
clearly carries something of the atmosphere of the commodity. 
In the case of the other names the appropriateness'may not be 
so evident. The belief is fairly general that heavy faced type 
carry with them the atmosphere or feeling of solidity and strength, 
and that the thin faced typo suggest fineness nnd delicacy. Figure 
2 shows in a striking way the type facos that arc supposed to. 
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cany the atmosphere of cheapness, dignity, fejnininity, antiquity, 
nature, and elegance. 

The only published experimental study known to the authors 
of the approprinteness of type faces is that of Berliner.* She 
measured, by the order of merit method, the relative suitability 
of eighteen styles of hondlettered type for advorti.sing each of 
four different commodities, namely, fish, pork and beans, pan-cake 
flour and orange marmalade. Four groups of people wore used 
in the measurements, The coefficients of correlation among the 
groups for any one commodity will show the degree of agreement 
among the groups concerning the appropriateness of the type 
faces for that commodity. The average cocfTicicnt of correlation 
for each of the four articles is given below*. 


Pish 

+.71 

Pork and Beans 

+.74 

Pancake Flour 

+ .G2 

Orange Marmalade 

+.50 


The author interpreted these coefficients ns indicating the degree 
of definiteness -of the atmospheve possessed by Ihe commodiUes, 
and as the figui’es show, this dcfinitenuss varied somewhat with 
the commodity. 

If now the average orders obtained from any group of subjects 
for the diiTorent commodities ore correlated, the si/rG of the cocfiici- 
ents will indicate tlic tlegi'ee to which the order of the type varied 
for the difl’ereut commodities or what the author called the speci¬ 
ficity of the nlniosphere. The following figures (Table I) were 
obtained from tbo judgments of a gi'oup of one hundred people: 




TABLE I 






1 

2 

3 

4 

1, 

Pish 

— 




2. 

Pork and Beans 

+.75 

— 



3. 

Pancake Flour 

+ .15 

+ .20 

_ 


4. 

Orange Marm, 

-.32 

-.15 

+ .31 

— 


Thus, the order for fish and orange marmalade tended to be 
reversed, (-.32), that is, the stylo of type that was most appropri¬ 
ate for flsh tended to be the least appropriate for marmalade. On 
the other hand, for fish and pork and beans the orders resembled 
each other very closely (-f-.76). The author concludes that com¬ 
modities might be grouped into classes according to the character 
• of their atmosphere and that type might then be chosen which 

‘ZtHcl], (, AuBowniulto Fnycho]., Pel, 11. 1020, 
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woiild be appropriate for any member of the class. 

The experiment.s to be described in this report differ from those 
of Berliner in several respects, namely: 

1. Instead of hand lettering, the material consisted of twenty- 
nine of the type faces commonly used for advertising work. 

2. Appropriateness of type faces for botli abstract qualities 
and for actual commodities was measured. 

3. The judgments of men and women were kept separate in 
order to .‘diow whether sex differences in this fonn of 
reaction were present. 

4. In only a few cases was the same person asked to judge 
more tlian one commodity, and then only after an interval 
long enough to minimize the effect of the memory of pre¬ 
vious arrangements. 


A modified form of the order of merit method was employed in 
this work on account of the large number of specimens to be 
judged. The type faces each mounted on a separate card were 
first sorted by each judge into five piles, the first pile containing 
the most appropriate and the last one containing the least appro¬ 
priate specimens. The order of the specimens was next determined 
within each of the five groups. Finally, the specimens in the five' 
groups were put together into a single order, From forty to 
fifty judgments were obtained in this manner for each of the ten 
categories given below: 


Cheapness 

Dignity 

Economy 

Luxury 

Strength 


Automobiles ^ 
Building Material 
Coffee 
Jewelry 
Perfume 


On the following pages are given the samples of type faces used 
in the experiments with their technical names and also the final 
rank’ obtained by each specimen when judged for its appropriate¬ 
ness for each of the categories listed above. Position I indicates 
the most appropriate specimen, and 29 the least. As there were 
twenty-nine specimens, the position of any specimen may vary 
from 1 to 29. The type as illustrated in this report are somewhat 
smaller than those used in the actual experiment, having been 
reduced in order to fit the printed page. 

>Thc nviiros rpnrcHcnt ranks olitnlncd from men aubjccts) only, Ab -wllL 
be tlemonutrfiLod liiteti the reiicUons of the Boxeb In this Ktiuly lire bo 
Blmltnr nb to imikc prQsentntlon of both acts of llgurcB unueceBsary, 
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WHEN, in the course of human 
^events, it becomes necessary $ 1234 £r 



A- 

-Della Robbia 


Cheapness 

17 

Automobiles 

12 

Dignity 

14 

Biulding- MaLeriDi 

16 

Economy 

5 

Coffee 

16 

Luxuiy 

12 

Jewelry 

12 

Strength 

16 

Perfume 

6 


WHEN, IN THE COURSE OF HU- 
B mail events, it becomes necessary 
for one people to dissolve $12345& 



B—Bodoni 

Bold 


Cheapness 

7 

Automobiles 

6 

Dignity 

17 

Building Material 

9 

Economy 

9 

Coffee 

10 

Luxury 

16 

Jewelry 

20 

Strength 

g 

Perfume 

21 


WHEN, IN THE COURSE OF $12 
^ human events, it becomes 34 

C—John Hancock 


Cheapness 

2 

Automobiles 

8,5 

Dignity 

23 

Building Material 

3.B 

Economy 

14 

Coffee 

2 

Luxury 

2S 

Jewelry 

26 

Strength 

3 

Perfume 

28 
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D Y/\ (ICM, 

(M 'Cl 

(!>: ocyciits! 

C Oil' 

huiuan • 


it boCO'iUi^S 



D—Roycroft Tinted 


‘ChoapnGSS 

25 

Automobiles 

22 

Dignity 

6 

Building Material 

20 

Economy 

27 

Coffee 

18 

Luxury 

7 

Jewelry 

7 

Strength 

19 

Perfume 

8 


WHEN, IN THE COURSE OF 

human events, it becomes neces $12 



E—New 

Caslon Italic 


'Cheapneaa 

15 

Automobiles 

7 

Dignity 

12 

Building Material 

19 

Economy 

19 

Coffee 

19 

Luxury 

11 

Jewelry 

19 

Strength 

17 

Perfume 

10 


p WHEN IN THE COURSE OF HUMAN 
^ EVENTS IT BECOMES NEC S1234 


F—Blair 


Cheapness 

21 

Automobiles 

23 

Dignity 

7 

Building Material 

22 

Economy 

11 

Coffee 

22 

Luxury 

10 

Jewelry 

8 

Strenpith 

21 

Perfume 

11 
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WHEN, IN THE COURSE OF 

human events, it becomes $i2345&; 


G—Cnalon Old Stylo No. 471 


Ghcnpness 

13.5 

Automobiles 

15 

Dignity 

13 

Building Matcrml 

15 

Economy 

6 

Coffee 

11 

Luxury 

13 

Jewelry 

13 

Strensth 

18 

Perfume 

14 

WH£N, 


THE COURSE 

OF 

H human events, it becomes necessary for 

one 

people to dissolve the political $123456'!^ 

H—Caalon Old 

Style No. 471 Italic 


Cheapness 

24 

Automobiles 

17 

Dignity 

8.5 

Building Muterial 

2j 

Economy 

24 

Coffee 

27 

Luxury 

6 

Jewelry 

3, 

Strength 

27 

Perfume 

2 


WHEN, IN THE COURSE OF HUMAN 
events, it becomes necessary for $123 


I—Now York Gothic 


Cheapness 

13.6 

Automobiles 

20 

Dignity 

15 

Building Material 

8 

Economy 

4 

Coffee 

14 

Luxury 

17 

Jewelry 

2Z 

Strength 

8 

Perfume 

22. 


WHEN, in the course of human events, it be- 
J comes necessary for one people to dissolve 
the political bands which have con $123456&r 



J—Century 

Old Style 


Cheapness 

11 

Automobiles 

24 

Dignity 

22 

Building material 

25 

Economy 

2 

Coffee 

1ft 

Luxury 

18 

Jewelry 

21 

Strength 

24 

Perfume 

1& 
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K ill tifp rnurar nf Ijiiman 



K- 

-Old English 


Cheapnesa 

22 

Automobiles 

26 

Dignity 

4 

Building Material 

23 

Economy 

28 

Coffee 

23 

Luxury 

4 

Jewelry 

11 

Streng'th 

15 

Perfume 

Id 

WHEN, 

IN 

THE COURSE 

OF 


human events, it becomes $12345 Sl 


L—Goudy Old Style 


Cheapness 

10 

Automobiles 

16 

Dignity 

11 

Building Material 

17 

Economy 

8 

Coffee 

17 

Luxury 

16 

Jewelry 

10 

Strength 

20 

Perfume 

9 


WHEN, ir) the course of human 
M events, it becomes necessary for 
one people to dissolve $12345r>7& 


M—Scotch Roman 


Cheapnesa 

19 

Automobiles 

13 

Dignity 

19 

Building Material 

13 

Economy 

3 

Coffee 

12 

Luxury 

20 

Jewelry 

16 

Strength 

14 

Perfume 

17 

WHEN, 

IN' THE COUKSE ' 

OF.HUMAN EVENTS, IT. BECOMES 

I’ necessary 

for one people lo dissolve Ihe political bands wIiich-rTave,' 

N'—Circular Gothic No. 44 

$123^, 

Cheapness 

20 

Aulomobiles 

28 

Dignity 

10 

Building Material 

26 

Economy 

16 

Coffee 

28 

Luxury 

8 

Jewelry 

B 

Strength 

26 

Perfume 

3 
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WHEN, IN THE COUKSE 
o of human events, it becomes 
necessary for one $1234& 


0—Antique Bold 


Cheapness 

1 

Automobiles 

3 

Dignity 

27 

Building Mnterml 

1 

Economy 

18 

Coffee 

3 

Luxury 

26 

Jewelry 

28 

Strength 

2 

Perfume 

25 


p WHEN, IN THE COURSE 
** of human events, it 


P—Mastcrmnn 


Cheapness 


Dignity 20 

Economy 20 

Luxury 23 

Strength *4 


Automobiles 2 

Building Mntcrial 2 

Coffee 6 

Jewelry 20 

Perfume 24 


V/l /V ^CCOttlCA f\ecct\A{i-t^ 

Q finm /a //re po/UiC4tf ^andA W^4cJf jftfOa can^iecAn/ 

ear//^ und dAiAo/t & xiiic^ fi/23->S67890& 


Cheapness 

Dignity 

Economy 

Luxury 

Strength 


Q—^Typo Slope 

28 Automobiles 

B Building Material 

26 Coffee 

3 Jewelry 

29 Perfume 


20 

29 

29 

2 

1 
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WHEN, IN THE COURSE 

of human events, it $ 123 & 


It—Century Bold 


Cheapnoas 

0 

Automobiles 

1 

Dignity 

29 

Building Material 

3.5 

Economy 

21 

Coffee 

7 

Luxury 

27 

Jewelry 


Strength 

5 

Perfume 

28 


WHEN, in the course of human 
s events, it becomes necessary 
for one people to dis- $12345&. 



S—Post 

Monotone 


Chcapncaa 

12 

Automobiles 

11 

Dignity 

16 

Building Material 

11 

Economy 

7 

Coffee 

9 

Luxury 

21 

Jewelry 

18 

Strength 

10 

Perfume 

16 


^ WHEN, IN THE COURSE OF 
human events, it beco $123456& 

T—Caslon Old Style 


Cheapness 

9 

Automobiles 

6 

Dignity 

18 

Building Material 

12 

Economy 

10 

Coffee 

8 

Luxury 

19 

Jewelry 

17 

Strength 

11 

Perfume 

20 


u WHENp IIM THE COURSE OF $1 

U—Cheltenham Bold Outline 


Cheapness 

26 

Automobiles 

21 

Dignity 

8.5 

Building Material 

21 

Economy 

23 

Coffee 

20 

Luxury 

9 

Jewelry 

6 

Strength 

23 

Perfume 

7 
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V iu‘Hu'.(!louvsi« of'jluniu\u 



V—Tiffniiy Text 


Cheapness 

29 

Automobiles 

18 

Dignity 

2 

Building MiiLorial 

28 

EeoTiQTny 

25 

Cuffeu 

26 

Luxury 

1 

Jewelry 

3.6 

Strength 

28 

Perfume 

6 


^ WHEN, in the course of hu¬ 
man events, it becomes $1234 



W—Bookmnn 

Old Style 


Chenpneas 

H> 

Automobiles 

10 

Dignity 

24 

BuiliUng Mcvfcci'mi 

10 

Economy 

1 

ColTcc 

13 

Luxury 

22 

Jewelry 

21 

Strength 

12 

Perfume 

19 


WHEN, IN THE COURSE OF 

Kuman events, it becomes $1234& 



X—ChoUoiilinm Bold 


Cheapness 

8 

Automobiles 

4 

Dignity 

21 

Building MnLcrial 

6 

Economy 

12 

Coffee 

6 

Luxury 

24 

Jewelry 

23 

Strength 

1 

Perfume 

26 

Y WHEN, 

IN THE 

1 

1 

m 

events, 

it becomes uec $1234' 


Y—Globe Gothic Bold 


Cheapness 

3 

Auloinobilus 

14 

Diginty 

28 

Building Malerinl 

6 

Eeowomy 

n 

CoITee 

1 

Luxury 

29 

Jewelry 

29 

Strength 

1 

Perfume 

29 
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wuRN. IN' TrinK «n(nnjiRe!i.; or iuw^ian ijsvHSNxa 


Z—Engraver's Roman 


Cheapneaa 

27 

Automobilea 

27 

Digni hy 

3 

Building Material 

27 

Economy 

22 

Coffee 

24 

Luxury 

2 

Jewelry 

1 

Strength 

25 

Perfume 

4 


WHEN, IN THE COURE OF HU 
’^'events, it becomes necessary $12 



X'- 

—Roycvoft 


Cheapness 

4 

Automobiles 

8.5 

Dignity 

25 

Building Material 

7 

Economy 

16 

Coffee 

4 

Luxury 

28 

Jewelry 

27 

Strength 

6 

Perfume 

27 


WHEN, IN THE COURSE OF HU- 

y J 

man events, it becomes SI23456& 


Y'—Bulfinch 


Cheapness 

18 

Automobiles 

Dignity 

20 

Building Material 

Economy 

13' 

Coffee 

Luxury 

14 

Jewelry 

Strength 

14 

Perfume 


in tlje CouiOf 

of lf;)uinan $ 


Z'—Priory 

Text 

Cheapness 

23 

Automobilea 

Dignity 

1 

Building Material 

Economy 

29 

Coffee 

Luxury 

5 

Jewelry 

Strength 

22 

Perfume 


19 

14 

15 

14 

15 


26 

24 

25 
9 

13 
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An examination of the positions assigned to the specimens when 
judged for the ten types of appropriateness sliows that their re¬ 
lative effectiveness varies according to the purpose for which 
they avG to be used. Dilferencea in the degree of variation are 
also to be noted. For example, apccinicn Y’ varies only from posi¬ 
tion 13 to position 20 in the ten categories, while Z‘ varies nil 
the way from 1 to 29. The former typo apociinen avouIcI serve 
moderately well for any purpose, while the latter is cither very 
Bpvopriate or very inappropriate. The same may be suicl of speci¬ 
men Z. The range and distribution of the positions assigned to 
the type specimens may be observed readily from Table 11. The 
positions from 1 to 29 are arranged in six groups, indicated 
across the top of the table. The figures in the body of the table 
indicate the number of limes that a given specimen fell in a cer¬ 
tain group regardless of the commodity for which it was judged. 
Thus specimen A was twice given a position within the 6-9 
group, end 4 times within the 10-14 group. More dclailed infor¬ 
mation concerning range and distribution may 'be obtained from 
the figures given undei’ each of the type specimens, 

If values be assigned to the groups in Table II, so that the first 
group is given a value of 1, the second group is given n value 
of 2, etc., the total value assigned to each type face may be 
roughly determined. Such total values would indicate wliich 
type, if any, tended to be consistently appropriate or inappropri¬ 
ate wherever used, These values are given in Table III. No one 
of the specimens stands out ns generally best or generally poorest. 
Specimen B appeal’s to be the most eflbetive for nil purposes and 
specimen J the least effective. But the diffei’encea arc slight. 

TABLE III 


A 

32 

G 

30 

M 

34 

S 

33 

Y 

30 

B 

29 

H 

38 

N 

41 

T 

32 

Z 

38 

C 

32 

I 

34 

0 

32 

U 

39 


36 

D 

3d 

J 

42 

P 

34 

V 

3D 

Y' 

36 

E 

35 

K 

40 

Q 

41 

W 

36 

Z' 

41 

F 

38 

L 

36 

R 

36 

X 

33 




The relation among the ordei's for the different categories may 
be expressed in terms of coelUcients of correlation, the higher 
the positive correlation the gi'cater the similarity among the 
orders lor the different categories. The coefficients obtained by 
the Rank Difference Method m’e given in Table IV for the men and 
in Table V for the women. 

In interpreting these figures it should !be remembeved that the 
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TABLE II 


ItANOK Ol' VOSITUINS ASSIfiNUI) TO KACJr SPKCIWrJN 


Type 

I'osiLioii 1-4 

6-9 

10-14 

16-19 

20-24 

26-29 

A 


a 

4 

4 



6 


4 

Z 

2 

2 


C 

4 

1 

1 


1 

3 

D 


4 


2 

2 

2 

E 


1 

3 

6 



F 


2 

3 


5 


G 


1 

S 

1 



H 

2 

2 


1 

2 

3 

I 

1 

2 

2 

2 

3 


J 

1 


1 

3 

4 

1 

K 

2 


1 

2 

8 

2 

L 


2 

2 

6 

1 


M 

1 


4 

4 

1 


N 

1 

2 

1 

1 

1 

4 

0 

4 



1 


4 

P 

3 

2 



3 

2 

Q 

3 

1 




0 

R 

2 

3 



3 

2 

S 


2 

4 

3 

1 


T 


3 

3 

3 

1 


U 


4 



5 

1 

V 

3 

1 


1 


5 

w 

1 


6 

1 

3 


X 

1 

4 

1 


3 

1 

Y 

a 

1 

1 

1 


4 

z 

4 




2 

4 

X* 

2 

3 


I 


4 

Y* 



6 

4 

1 


Z‘ 

1 

2 

a 


3 

3 
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groups of persons judging were not the saine foi* any two categor- 
ies and that rarely was the same judge used twice. Thus, the high 
negative correlation^ between the orders for Cheapness and Digni¬ 
ty (—.34) or between Cheapness and Luxury (-.94) repre¬ 
sents a real difference in effectiveness and not merely a tendency 
on the part of the judges to be logical, in placing a given specimen 
high for one quality and low for some contrasting quality. The 
coefficients for Cheapness and Economy (+.47) and for Dignity 
and Luxury (+.96) are high and positive. Strength correlates 
positively with Cheapness (+.82) and with Economy (+.31) 
while it correlates negatively with Luxury (-.96) nnd with Dig¬ 
nity (-.89). Plain heavy type, while indicating strength, also 
suggest cheapness and economy as compared with the more deli¬ 
cate and ornate type forms. 

A coefficient of correlation of +.94 between the orders for 
Jewelry and Perfume indicates that the type faces that are 
most appropriate for the one arc also most appropriate for the 
other. These two commodities correlate with the orders for 
Automobiles and Building Material -.96 and -.92 respectively, 
showing that the type forms most effective for the one group 
are the least effective for the other group. 

The order for Coffee, while quite similar to that for Building 
Material (+.90) and for Automobiles (+.81) is quite different 
from that for Jewelry (-.91) and Perfume (-.96). 

Interesting comparisons may be made between the abstract 
group (Dignity, Economy, etc.) and the commodity group (Auto- 
TfiobiVes, Ettilding MateTial, Cheapne^iS correlates positively 

nnd high with Coffee (+.90) and negatively and high with 
Jewelry (-.94,), and Perfume (-.88). Dignity correlates high 
and positive with Jewelry (+.89) and with Perfume (+.80). 
The orders for Economy and Automobiles show n correlation of 
+.28, Economy and Building Material +.40, and Economy with 
Coffee +.38. There is a negative relationship between the orders 
for Economy and Jewelry (-.38) and Economy and Perfume 
(-.29). The coefficients in which Economy is concerned are the 
lowest to be found in the table. Luxury correlates high and 
positively with Jewelry (+.93) and Perfume (+188) and neg¬ 
atively with the other commodities. Strength correlates high 
and positively with Automobiles (+.73), Building Material (+.93) 
and Coffee (+.91), but negatively and high with Jewelry (-1.00) 
and Perfume (-1.00). 


^The fftllowliig tntoviirQtntlons will be based on the flEures tor tneu 
given In Tnble IV, 



TABLE IV 

Correlations among tee orders for men 
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table VI. 


COllllKI-A'I'lON 

nUTWERN MEN 

ANn WOMEN ron di 1 ''I' 

'iniENT' 

rATunimiKs 


Cheapness 

+ .91 

Automobilo.s 

+ ,81' 

Dignity 

+.92 

Building Mntcrinl 

+.97' 

Economy 

+.93 

Coffee 

+.79 

Luxury 

+.93 

Jewelry 

-1-,9'1 

Strength 

+.9-1 

PevCumc 

+.05- 


No fUfl'oi'eiiccs worth notini; appoiir hotwcen tlic records for 
■men and women. (Tobies IV nnd V). Table VI aliowinfr the re- 
lationshic) between the orders for men anil women conLnina no- 
cocfTieicnl lower than +.71). This siniilariLy of the reactions in' 
the two sexes pives additional evidence of the consistency of the- 
jufl(!:nient.s of niiproprinlcne.s.s of mntorinl of tliis sort. 

The rcsulLs of this oxiieriment show quite concUisively that 
diircrin"- typo faces do vary in appropriateness and Lhiit judpe.s 
arc able to "feel'’ this approprintcno.ss or Inch or nppropnatene.ss. 
Furthermore, there is close aErcement between sexes and amouE 
members of the same .sex in the chnracLcr of their rcacliona to 
the difFerent type specimens. 

The experinienL produces no incnsuro of the atrenRth of these' 
"feelings’'. Certainly, the pleasantness or unpleasantness of the 
effects produced by these different type faces must be oxtrenicly 
mild, and it might bo argued that such differences n.s do exist 
are too slight to warrant considcrnlion for practical purposes- 
Ho-wover, the npproin'iatcncss ol type is one factor among the 
many which determine the upprapriatenesa of the advertisement 
ns a whole nnd therefore cannot be snfely neglected. 

Some theoretical interest may attach to the question of the- 
cause of the differences found in this experiment. There arc two- 
pos.siblc explanations. First, the type faces, by their shape, size, 
texture and the character of their lines may carry a certain at¬ 
mosphere about them; there may bo inherent in them an atmos¬ 
phere of delicacy, dignity or strength. Second, the utmoaphere- 
which they possess may be merely a matter of use. For example,, 
we are accustomed to seeing Old English or .similar typo, such 
as specimens K, V, or Z' used for imposing nnd dignified documents 
nnd plain, heavy type such as specimens 0 and Y for simple and: 
ordinary pr-inting purposes. By the process of association the 
type may now carry the qualities transCerxed from the settings in, 
which they have habitually appeared. 

For present practical purpose it would seem to mnlco little 
difference which of these interpretations is correct. It is suf¬ 
ficient to know that type faces such as are used in current ad.- 
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vei'tisinj? prncLico do have charncteristic atmoaphere and that 
these slioiild be Riven due weight. 

One turlhov point nhonUI be noted, namely, that tbs efTective- 
11C53 of type fiieos Kueh as wc have used in this work cannot, 
necessarily be prodicLcd from the judgment of one individual, 
even tlioiiRh he nmy be un expert in typography. Only a test 
upon an iulcKpuiLo snmpling of Uie population to bo influenced 
will definitely determine what is the best type to use. The 
judgment of one individuiil may he safer where the more extreme 
forms of ImndleLLering are under consideration, although even 
here .some fiirtlier cheek \vould he advisable. The elTecL upon a 
sampling of prospects must here, os in other cases of control of 
hninau behavior, be tlic final inea.suve of what will or will not be' 
effeclive. 



INTELLIGENCE TESTS VERSUS ENTRANCE 
EXAMINATIONS AS A MEANS OF PREDICTING 
SUCCESS IN COLLEGE 

By Ada Hart Arlitt and MAKtiAWKT IIai.i. 

Bryn Mawr Coli-kck 

This investigation begun in 1919 and conijdettid in June, 1923 
wns unclei’talccn to determine (1) the relative value of tlio record 
in intelligence tests and the record in eiiLriinco exaininalioiiH us 
a means of predicting success in a college whieh ndiniLs only 
through the regular channels of entrance exinniiiations, (2) the 
extent Lo which the record in inteUigence testa could he used to 
exclude students who succeeded in passing entrance examinations 
but were not capable of doing adequate work in collage, (3) the 
relative merits of two intelligence tests and entrance oxainiimLion 
grades as a means of selecting the students wlio will do LliG least 
adeciuntc work in college, 

The subjects, 306 in all, were students who entered Bryn Mawr 
in 1919, 1920 and 1921. The test results for each class were 
treated separately. As a matter of convenience the classes will 
hereafter be termed Group I, Group 11, and Group III in the 
order of the date of entrance into college, Students who withdrew 
for any reason other than poor work bcfoi'c Lho end of Frcslinian 
year and students who were given only one of the two test scries 
in the class to which two seta of tests were given are not included 
in this study. 

Group I wns given the Stanford Heviaion of the Dinet Te-st 
used in part as n group test. Intcrpvctntion of Fables (X3/I, 2), 
Memory for Paragraph (XVIH, 4) and the Vocabulary Tost (XVI, 
1 and XVIIIj 1) were given to the group as a wliole. In the first 
two of these tests the procedure followed was the same as that 
outlined by Terman except that the responses of tho students were 
written in a regulation college "Blue Book”. For the Vocabulary 
Test each student was given the list of one hundred words printed 
with sufficient space after each word to allow for the writing of 
a definition. Ample time was allowed to finish each test. The 
Vocabulary Tost was given last and the paper handed in as soon 
as completed. All of the other tests were given individually by 
the writer. 

Group II was also given the Stanford Revision of the Binet 

'I’lif wvHci- wislics Ml sic-lsiion-li'duo her In MIhs Miipli 

(M’liidy, Si'ci'i'liiry ninl UvKlsInir of (1ii> Collcfa', fur lii-c ciui.slaiil I'li-niiiir- 
iiIIdii mill ('iiiii'lcKy In riii'nl-slilii); liu> ilalii ii.'i li> i‘iilriiiii-i' i'\intiiu:illuii 
ri'coriln iiijil Ki'iiilrs In colli-iji*. 
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Test with the same pvocedure as that described above except 
that the Inffemiity Test (XVIII,6) was also given as a group test,’ 
As soon as the tijne allowance of five minutes for each section 
of this test had elapsed the students turned over a page and began 
the new problem on n new sheet. In order to avoid work on a 
problem after tlie time limit for that problem was up, no student 
was allowed to turn back a single sheet for any purpose, Th& 
Thurstone Ercshninn Test, Series 1920 Number IV was also 
given to this group. Group III was given the Thurstone Fresh¬ 
man Test, Scries 1919. 

The results of the tests of Group I in terms of I. Q. were cor¬ 
related with grades received in entrance examinations and with 
marks at the end of the Freshman, Sophomore and Junior years, 
and at the middle of Senior year. Marks at the end of the 
Freshman and Sophomor-e years ai-e in terms of the average of 
all percentage grades received by the student during the year. 
Marks in the Junior and Senior years ore in terms of honor points,* 
Grades received in entrance examinations were also correlated 
with marks at the end of the Freshman, Sophomore and Junior 
years and at the middle of Senior year. The formula used waa 
the Product Moment with computations from the true average i 


2 J’ V 


V 2 Vs 


The results are presented in Table I. 

TABLE I 

No, of 
students 


98 Entrance grade.? and marks end of Freshman year .639 
83 Entrance grades and marks end of Sophomore year .548 
74 Entrance grades and marks end of Junior year 
74 Entrance grades and marks middle of Senior year 
98 I. Q.’s and Entrance grades 
98 I. Q.’s and marks end of Freshman year 
83 I. Q.’s and marks end of Sophomore year 
74 I. Q.'s and marks end of Junior year 
73 I. Q.’s and marks middle of Senior year 

As will be seen from Table I, 1. Q.'s show a positive but low 

‘TlilH Lfjil illd n..l li-na llsidf woH to use us o group lost In ab much 
UH til.- Hint! iilhum/ ftii- wreJi itiiiL wjih Iuo trn-«t for 
BHiilculs l.'sliMl, liiiL iiH liutl lo wall uiJlil tlic ontl o£ thu time “‘lowocl. 

“A ccriiitii imiuiJk’J- of honor iioJnls Js Jillowcd for ouch hour of vork o£ 
nigh Credit, Cieilll uhtl Merit BunUe. 


.541 

.642 

.245 

.298 

.007 

.102 

.100 


P. E. 
,048 
.052 
,065 
,056 
.0C4 
.062 
.073 
.078 
.078 



;332 


AIILITT 


■correlation* with marks at the end of Preshmon year nnd a negligi- 
blc correlation with marks at the end of Sophomore and Junior 
years. Grades receivetl in entrance examination show n marked 
positive correlation with marks received by the end of each of the 
three college ‘years. The coefficient of correlation for entrance 
grades and marks received in academic work is almost twice as 
large as that for I. Q.'s and marks at the end of Freshman year 
•and is more than four times as large as the coefficient of correla¬ 
tion for L Q.'s and college morks at the end of Sophomore and 
Junior years and at the middle of Senior year.' 

The resulta obtained from coi'relating the two intelligence tests 
used with Group II with marks received in academic work, nnd 
■entrance examination grades with college marks are presented in 
Table II. I. Q.'b ahow a positive but low correlation with college 
marks at the end of Freshman year (.I97±.064) and at the end of 
Sophomore year (.166±.070). Thurstono Test Scores show a 
bigher correlation with college marks at the end of both years than 
do I. Q.’s. The correlation between entrance gi'ades nnd college 
marks at the end of the Freshman year is .620±.0d8 nnd at the 
end of Sophomore year is .486±.065. 

TABLE n 


No. 

of 



students 

r 

r,E. 

103 

Entrance grades ond marks end of Freshman year 

.920 

.048 

88 

Entrance grades and marks end of Sophomore year 

.486 

.066 

T03 

Entrance grades and I. Q. 

,190 

.064 

103 

I. Q. and Freshman marks 

.197 

.064 

88 

I. Q. and Sophomore marks 

.16G 

.070 

103 

I. Q. and Thurstone Scores 

.223 

.063 


103 Thurstone Scores and l^cshman marks ,274 .061 

8B Thurstone Scores and Sophomore marks .293 .066 

Here, ns with Group I, entrance grades show n much higher 
correlation with Academic success than do the scores in either of 
the Intelligence Tests. 

The results from Group III are presented in Table III. En- 
trancB grades correlate .638±.039 with marks received in the 


‘Till' Classincntloii fnllowed lioro Is lliimi'a. Hiiffa, H. O. SLntlHtlcal 

Mi‘tli(Kla AiipllL'il tu Krfiicrtllcm, p. 23(J. (lIouKliUin SIUlUii Co, 1017.) 

Tlio inai’la'd dQcit'HHV In tin* h1k«‘ of tim Ijoyond tlio l'’i'crtli- 

inrin yoiir limy lio c;x{>iiili>(><l In pact lijr ilio fuol (iiai a mmiliiT nl’ Kdidciits 

low In boLli enulL*!) iinO Bcorcs In Intpllleuiicu luata wltlidraw al llio «nc] 
of the li'rOHlnnini year. 'I’liis (looa not, liowcvor, acuoiiiil for all of the 

•change. 
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"FreghmQn year while Thuratone scores show a correlation of .347 
±.0B8 with Freshman marks. 

TABLE III 

No. of 

students j. pjj_ 

104 Entrance grades and marks end of Freshman year .638 .039 

104 Tliurstone Scores and marks end of Freshman year .347 .068 
104 Thuratone Scores and entrance grades .298 .060 

The results presented in Tables I, 11 and III show that of the 
three Measures on which prediction of. success in the Freshman 
year in college might be based, grades in entrance examinations 
rank first, Thurstone Test scores next and I. Q.'s last. In the case 
of the last two mensuroa the difference between the sizes of the 

• correlation coefficients in the one group to which both tests were 
administered in 7.7 points at the end of the Freshman year and 12.7 
points at the end of the Sophomore year. No one of the three meas¬ 
ures show a correlation which may be regarded as "high" accord¬ 
ing to Rugg’s Glassification except in the case of entrance grades 
.and Freshman marks in Group III. 

A study was then undertaken to determine whether the records 
in intelligence tests might have been used to exclude students who, 
although able to pass the entrance examination, made unusually 
poor records in college. Each group was divided into quartiles 
according to rank in college marks. Table IV shows the distri¬ 
bution in quartiles according to rank in college marks of the stud- 
dents at or below the 26th percentile in entrance grades, in Tliur- 
stone scores and in I. Q.'s. In the case of Groups I and 11 a low 
grade in entrance examinations is more indicative that the student 
will do less than average work in college than is a low score in 
intelligence tests as is shown by the fact that a larger per cent of 
the students ranking below the 26th percentile in entrance grade 
rank below the 26th percentile and median in college grade. Of the 
students ranking below the 26 percentile in I, Q. in Groups I and 
II, 47% rank below the median in college grade at the end of 
Freshman and Sophomore years. Of those ranking below the 26 
percentile in Thurstone scores 60% rank below the median in 
college grade and of those ranking below the 26 percentile in 

• entrance grade 70% rank below the median in college grade. In 
Group III the intelligence test and entrance grade select the 
poorer students almost equally well, but the Thurstone test shows 
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TABLE IV 

DIKTIlinUTION IN HANK IN COLI^EGN MAUKS. 


Group 

I 

No, Btiulunts 
below ST) per- 
cenLllc In 
IntGUlBcnce 
QuoLlont 

24 

Year 

Freshman 

below 

0 -, 

>«> 

rcrcontlle 

9 

No. 1>('* No. bo- 
Lwnon 2.' Iwccii 00 
iiiMlOO (111(170 
porccntlb! pevccnlllo 

6 G 

No. above- 
7.3 iier- 
centUo 

3 

I 

18 

Sophomore 

6 

3 

6 

6 

II 

2C 

Freshman 

6 

6 

8 

7 

II 

21 

Sophomore 

3 

6 

7 

0. 

I 

No. of fitu- 
dcntti below 
2.’j pcreciitllc 
In Enlcnncc 
Examination 

24 

Freshman 

10 

9 

3 

2: 

I 

17 

Sophomore 

7 

6 

4 

1 

II 

26 

Preshmon 

11 

6 

7 

2, 

II 

21 

Sophomore 

9 

5 

4 

3 

III 

20 

Freshman 

10 

9 

7 

0 

II 

No. below 23 
perceuLlle lii 
Tluirstone 
Score 

26 

Freshman 

7 

9 

7 

3 

II 

22 

Sophomore 

8 

6 

G 

3 

III 

26 

Freshman 

10 

11 

3 

2 

itself 

to be slightly superior to the entrance grade. Of the students 


ranking below the 25th percentile in Thurstonc score 80% rank below 
median in college marks as against 70% in the case of those rank¬ 
ing below the 26 th percentile in entrance grudefl. 

As a final test of the selective capacity of the three measures, 
a comparison was made of the standing in. college of the six 
students ranking lowest in entrance grades, tlio six ranking lowest 
in 1. Q., and the six ranking lowest in Thurstonc scores in each 
group. This represents approximately the lowest G% of the 
group, Of the six students ranking lowest in I. Q. in Group I 
three were below the 26th percentile of the class in college grades, 
two were between the 26th percentile and the median, none between 
the median and 76th percentile and one above the 75th percentilo. 
Two of the three students below the 26th percentile were dropped 
at the end of Freshman year because of poor work. None of the 
six lowest in entrance grades were dropped and only one of the 
six was below the 26th percentile. 

The six students in Group 11 ranking lowest in Thurstone score 
were distributed as follows; o:\e waa below the 26th percccntile,. 
two were between the 26th percentile and median, two were between 
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the median and 75th percentile and one was above the 76th percen¬ 
tile. Of the six ranking lowest in I. Q. two were dropped at the end 
of the year because of poor work, two were between the 26th per¬ 
centile and median and two between the median and 75th per¬ 
centile, Of the six ranking lowest in enti-ance grades two were 
below the 25Lh percentile, three between the 2Bth percentile and 
median and one between the median and 75th percentile. None of 
the six ranking lowest in entrance grades were dropped because 
of poor work. Of the aix students ranking lowest in Thuratone 
score in Group III one was dropped because of poor work, and of 
the six lowest in entrance grade one was dropped. 

Although the Thurstons Test is, as has been shown by its corre¬ 
lations, a better measure on which to base prediction of success in 
college than is the I, Q. and although entrance grades is a better 
measure on which to base prediction of success in college than is 
the score in cither of the intelligence tests, the I. Q. selects the 
students who will do the poorest work in college better than does 
either the score in Thurstone Test or the grade in entrance examina¬ 
tions. A study, however, of the distribution by qiiartiles in rank in 
college grade of the six students lowest in intelligence tests will 
sei've to show ilmt to use the I’csults of such tests to eliminate 
students who have passed the entrance examinations would be 
nmnife.stly unfaii’. 

The result of our tests show three things (1) that neither the 
Thurstone Test score nor the 1. Q. correlated a.s highly with marks 
received in college as did grades received in entrance examina¬ 
tions, (2) that the Intelligence Tests could not with fairness be 
used to exclude students who had passed the entrance examina¬ 
tions since a large percentage of the students at or below the 
25th percentile in Intelligence Test score do adequate college work 
and less than half of the lowest five per cent in Intelligence 
Tests are excluded from college for poor work, (3) that the I. Q.'s 
selected the students whose work proved poorest, better than did 
the ontrance examination grade or the score in the Thurstone Test. 

That our results are in no way unique can be seen from a com- 
parision of our results with those of previous investigators in 
the same field. The following table cited from Caldwell brings 
together the data from a number of such studies. 

The coefficient of correlation between coUeg'C marks and intelli- 



336 


AULITT 


gcnco tests is shown in 

the column at the right. 

Wiasler 

.09 

Calfcc 

.23 

ItowliMul and Lowden 

.37 

Waugh 

.41 

Bell 

,31 

Ititaon 

.44 

King and McCrory 

.39 

Caldwell 

.44 


To the above table may be adduil tbc following; 



Year 

r No.studeiils 

Te.sta u.sed 

Caldwell 

Sophomores 

.17 

24 

Stanford Revision 


Junior 

.69 

24 

Stanford Revision 

Kitson 

(Second group) 

.20 

40 

30 Selected Tests 

Rogers 

Seniors 

.42 

93 

Thorndike MenUil 
Alertness A, 


Seniors 

.39 

02 

Thorndike Mentol 
Alertness K. 


Preshmen 

.37 

182 

Thorndike Mental 
Alertness A. 


Freshmen 

.37 

182 

Thorndike Mental 
Alertness K. 


Freshmen 

.23 

182 

Reasoning I Rogers 


Freshmen 

.12 

182 

Reasoning la Rog. 

Colvin 

Freshmen 

.5981 

103 

Brown U. Testa 


Pre.shinen 

.4567 

210 

Army Alpha 


The coonicient of correlation in the studies cited in wliicli tests 
other than tlie Hlnnford Binet were used ranged from .01) to .59 but 
in most in.Htanccs varies by not more than ten points from our 
results with the Thurstone Teats. The only resulta comparable 
with ciuvs for the Stanford Binel are Caldwell's, llcvc the 
aoefbeiunt of correlation for Sophomores was about the same aa 
that in our results lor Sophomores in Group II but the coefficient 
of correlation for Juniors was much larger than ours due perhaps 
to the difference in the size of the groups. 

The fact that in our study scores in intelligence tests and college 
murks do not show closer agreement may bo explained in several 
ways. In the first place, as has been pointed out earlier in this 
study, the students dealt with are a highly selected group from 
which the le.ss able individuals have been for the most part elim¬ 
inated by failure to pass the entrance examinations. All but seven 
of the 201 students given the Stanford Bind have I. Q.'a above 100 
and the large majority of the students have nientol ages above 
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sfivnntecil. As lu Thuvstoiw; acoics Ihe lawchL sluilenb in Gvonp II 
scorea «t the pL'rceniile acuordinff to the norms lor this teat. 

Tlie lowosL .‘il.ndont in Group III also scores at the iOth percentile. 
The level of hitnlliKonce in the case of practically every student 
is high Guouj'h to warrant adequate work in college if interest, 
hnbit of work and Llio nucessury prcpai'atioii nvo also present. 
Fnctoi's oilier Limn inlrlliKencc may therefore play a Inveo part 
in the stmlont's ancceas. 

In thc! .second place very intciliRcnt students have often not been 
trained to worlc to Ihe liniil of their capacity in the lower .schools. 
Their mental level has been high enough to enable them to do 
fnivly satisfactory work with a minimum of effort. These students 
enter college with inadoqnate preparation its shown by low grades 
in entrance oxnmiimtions and with the habit of working only 
enough to “get through." If Lhia hnbit persists through all lour 
college years it may load lo a very intelligent student’s r-eceiving 
poor Tiiarks, 

III the third place some uf the most intelligent btudents are not 
interested primarily in college work, and unless pride in academic 
.success is sufTlclcnt to make these students put forth a deter' 
mined effort to obtain high grades most of their energy may find 
its outlet ill extra curriculum activities. 

Lastly the low correlation between the two intelligence tests 
u.set( I>y UH (.223) .suggests that thc validity of one or perhaps 
of both as tests which will differentiate between mental levels in 
adults may not he as great as could be desired. It may well bo 
that wu are expecting more of the tests u£ college students than 
we have expected of tests of children below fourteen. Our problem 
here Ik that of difl’crcnLiating between abilities at the top of the 
.scale, a far more (liHicuIt one than that of separating into groups 
tho whole rniige of mental ability. It is probable that this problem 
will require ns many years for its solution as elapsed between 
Binct'a first experiments with thc thirty tests in his original series 
and the publication of thc Stanford Revision of tho Binet Tests 
ill 1915. 

Full cooperation of college authorities and experimenters in 
the field of adult testing will, it is to he hoped, produce testa 
as valuable to the college as the Stanfoi-d Revision of the Binet 
7'cst has been to the lower schools. 



AltLiTT 


BIBLIOGRAPHY 

1. Boll, C, J. TcsIh flwd College FrcHlmcn. 

Jour. Ediic. Paychol. 7; 381, ISKi. 

2. Caldwell, H. H. Adult teats of the Stanford Revimn applied 

lo College students. 

Jour, Educ. Psychol., 10: 477, Dt:c, 1919. 

3. Calfee, M. College Freshmen and Four General Intelligence 

Teats, 

Jour, Educ. Psydiol., 4; 223, lOl.'l. 

4. Colvin, S. S. PN^/c/ioIflificn/ at Brown Univeraiig. 

School and Society, 10: 27, July 5, 1(119. 

6. King and McCrory. Freshmen Tests at the State Vnivmii]] 

of Iowa, 

Jour, Educ. Psychol. *J: 32, Jau, IDlfl, 

6. Kitson, H, T). The Scientific Study of the College StiidenL 
Psychol, Rev. Mon, 23, I, 1917. 

7. Rogers, A. L, HJenlal Tests As a Hhana of Selecting and 

Ckssifyhig Sindents, 

Jour. Educ, Psychol., 11: 181, 1920, 

8. Rowland, E. and Lowden, G. Report of Raychological Ted at 

Reed College. 

Jour. Expcir. Psychol, 1: 211, 19111. 

9. Wisskr, C, The C'oi’rc/«(inH of ilhntal and Phj/sioal Tests. 

Psychol, Rev. Mon. Sup. HI, 0: 1, 1901. 

10. Waugh, Karl, A New DittgM^is of the College Sliulent. 

New York Times Mag. Sup, Jun, 2, 191(1. 



A RE-INTERPRETATION OF THE STATISTICAL 
METHOD OP ARMY TRADE TESTS 


KY ARTIIUH W. KOItNlIAUSEn 
Univerflity of Chieneo 


Tlio procedure followed by the Army Trade Teat Division in 
the construction of oral Irndc tests has been described in several 
books nnd articlca'. We shall, therefore, include in the present 
pnper only n brief summary of the statistical method used in 
the treatment of teat ciucstions. This will serve as a basis for 
our critical discuasion. 

For each trade question ou which standardization data were 
collected, a graph like that shown in Figure I was constructed. 

The question is scored from 4 to 0, for n correct answer, 0 for 
incorrect, and intermediate scores for partially correct answers’. 
In the graph tho scores are rend in the column to the left, while 
across the top nre arranged the four trade classes—Novice, 
Apprentice, Journoymun, nnd Expert. Tho number of men of 
a given trade status making each score is entered in the table. 
Thus, 2 Novices scored 4; B Apprentices scored 4; 18 Novices 
scored 0; and so on. Twenty men of each class of ability are 
represontod in the graph. The average score for each class is 
obtained and entered nt the foot of the chart. These averages 
are plotted nnd a curve drawn to show graphically the relation 
between trade .ituUi.s and acoi-c. On the basis of an inspection of 
these graphs queations were I'ctained or eliminated. 

From those questions which were selected as showing sulTiciently 
"good” graphs, tlio ones were retained which, in combination, 
Would give the bo.sfc di.scrimination between Novices and Appren- 
ties, Appi’eiiliee.s aiul Journeymen, and Journeymen and Experts, 
Tjie final te.'^t consisted of some ten to twenty questions, the 
combined score on which wna then used In classifying the individ¬ 
ual tests. 

"VVe shall attempt to examine critically both the treatment of 
individual trade questions and tho method of combining and using 
these cjLiestions. Tho first—^llie manner of evaluating questions— 

'Tltc I’lTht.niul Sysiriu of llio Uiiltc-rt Avmy. Wu.slUiistoii: 

hUJiiKirii (Jctu'i'iirH in'ii.-jrliricHl, !})!». niapler 20. 

J. (1, ChiumiiiH. TriuU' Tchls. Xow York: IIoU, ID'Ji. 

Ailditliiiiiil rc'l’tTcnt-i'.s uiiiv lii. roiiiiil In IU‘ last sufiidonoil liook. 

-I'/ii'lliiJ rtciivs- ueiT rim^]y iiMMiJ In jiflmil prnetlcc. Tnoih' arc DVesPiU 
111 our llluslrunun. ThKiiiirluuil Ihi* yroKont piukt wo kIiiiII untlrriy 
Ikihu'I' iiiirtlnl iiiul uluill sin-uk of imsslng and falling as tlic oiilr 

allui-jjiil h'i‘.s. 
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requires a stutiaticnl ve-intcrprctation. The second, which has to 
do with the form of the test as a whole, is principally n matter 
of convenience nnd practical usefulness. 

The method of evaluating the individual queatioiw appear at 
once to be open to criticism regaining the statiHtical logic 
employed. The procedure makes use of the wrong regression line 
in considering the relation of ability and score. The inquiry 
made by tlie teclmiquc used is: Whnt arc the average scores 
made by tradesmen of the scvornl grades of ability? The proper 
question would be: What is the average (or most probable) 
trade status of tradesmen making a particulni’ score on a question? 
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Figure 1. 


On more careful examination, however, it will be found that 
while the procedure described does plot the wrong regression lino, 
actually that regression relation is not used ns a means of pre¬ 
diction. The regression equation that is, is not made use of 
either explicitly or implicitly. 

In order to moke clear the indirect use to which the regression 
of score on trade status is put, wo shall first discuss the logic 
underlying the evaluation nnd combining of questions, It will 
























STATISTICAL MKTIIOD OP AHMY TRADE TESTS 341 

then be noted -wiicrcin the Army method meets, and wherein it 
docs not meet, the staListiciil requirements. 

The i)rol>lein which \vc Imve, if we ask how well we can 
actunlly predict triulc slutu.H from score on the individual question 
nmy be forniulatiM) more ilerinitcly thus: What are the numerical 
odcis that (I inaii piiasiiip (ur failing) a question ia of one trade 
status rather than auolher ? 

A [of,dcal procedure for determining these odds follows; 

X X V .V 

(1) Let n , a , j , and o represent the numbers of Novices, 

Ajjpronticc.s, Journeyincn and Experts respectively 
wIkj take a given question,):. 

s X X 

(2) Assume that n = a z= j = o . 

(This is done in practice by using jDOrcentages, i. e.,, 
l)y referring results to a basis of 100 individuals in 
each trade class.) 

X \ X X 

(3) And let n , u , j , and e represent respectively the num- 

r r r p 

hers of Novices, Apprentices, Journeymen, and Ex¬ 
perts who give a ^‘right" answer to the question x. 

X X .<( X 

(-1) Similarly n , a , j , and e i-epresent tlie mimhers who 
w w «’ w 

give a “wrong" answer to the question. 

X X 

(6) Then clearly, the ratio of a to n expresses the odds 

r r 

that n man passing question x is an Apprentice 

X- .V \ X 

rather than a Novice, assuming n — n = j = e . 

X X 

(G) Correspondiiig atalements hold for the ratios j to a 

r r 

X X 

and 0 to j , and for ratios using percenlagea of 
r p 

failures in place of successes. 

Now these numerical expressions of the odds constitute pre¬ 
cisely the sort of relations we desire save, of course, that we 
must in practice talco into consideration the actual ine(]Ufdil]/ of 

X .X X X 

n , n , j , and e . The proper allowance for these Inequalities 
can be made only on the basis of data which ivill indicate roughly, 
at least, what the pi-oportion of Novices, Apprentices, Journey¬ 
men, and Experts are among men actually applying for employ¬ 
ment in tho given situation. 

(7) If now, N, A, J, and E represent the actual numbers of 
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trncloamen applying, 

X 

A n 

r 

(8) Then, - X -= the ocUls that a man who pagac& 

X 

N n 

r 

question x is on ApproiiLlce rather tlinn n Novice. 
That is to any, the fonnulntion of (5) must be 
corrected by wclglitiiiB the itoTU.s in iiccnidance with 
the actual number of Novices nnd AppronticQS who 
are nppliccinta. It ia to bo capecially noted that 
for the purpose of comparing one ciucstion with 
another the weightliiK is wholly unnecessary. Since 
it vernains constant, the relative merits of qvmstions 
can be judged quite us well by using simply the 

X 

n 

r 

ratios of the typo, -. 

X 

It 

r 

The expression (8) stands, then, as tt»e general answer to our 
t|ue.stion, by stating simply what the odds are, that n man passing 
n qiiestion is of one trade status ratlier than of anoLlior. Cor¬ 
responding expressions may readily bo written for other class dif¬ 
ferentiations and for situations in which the answer to the trade 
question is wrong instead of right. 

Let us now return to the Army procedure and examine it in the 
light of the preceding discussion. When tho-nverage score on a 
question was obtained for each trade class, wliah was really secured 
(as is evident from the nnture of the computation) wa.s the per¬ 
centage of the clas.s who pas.sed, multiplied by a con.sLant factor, 4. 
The regression line that was graphed, tlierefore, may bo tliought 
of simply as a curve showing the per cents of individuals passing 
at sncce.s.sive trade levels. 

To the extent that the regression line or curve of jier cents was 
of use in comparing the pevceulages of passes at adjacent trade 
status level.s, it possessed a certain value in indicating tlie proper 
selection of questions; to the extent that it gave a false notion 
of the relative excellence of differontiation at the .several level.s, 
it was unsatisfactory. The sharpness of ri.se in tlie curve between 
two groups was considered the significant fact, 'rhe height of the 
point from which the rise takes place play.s an imiiortiint part 
which was not .sufTicionLly considei-ed in the Army procedui’e. 
Consider this point in greater detail. Aa indicated in our Lheore- 
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-ticfil digcusaion, the critical cxprcsaione for determining difleS 

X 

a 

entifltion ore the ratios of the typ e, t ^ This ratio can 

Jc 

n 

r 

be obtained directly from the curve plotted for each question in 
the old proceduro. For exnmple, (See Figure 1) if the curve 
rises from .4 (Novice average) to 1.6 (Apprentice average), the 
desired ratio is 4 (i,e,, 1.0 divided by .4). In Army practice this 
ratio was not read. Whnt was taken as a criterion (usually im¬ 
plicitly, through estimated •steepncs.s of the curve) ia the absolute 
diif&vencG between successive points on the curve in the example 
just given, 1.2. Suppose, now, that the next point on the curve, 
the Journoymnn nveragci was 2.8. The absolute difference and 
the steepness of the curve remain constant; but the ratio which 
was 4 nfc the fii-st division is 1% nt the second. Actually, that 
is, the question diffei-entaato.s very much better between Apprentices 
ami Novices than between Journeymen and Apprentices, although 
tliD Army inothod of analysis shows equally good differentiation. 

The shortcoming.H of the Army pi'ocedure can, perhaps, be 
made clear by reference to a few sample graphs of questions. 
The.so are .showii in Figure 2, A man passing question B re¬ 
ceives the same credit ns ono passing A, even though passing B 
is alnio.st certainly diagnostic of Expert status whereas half tho 
men passing A are not Experts, one sixth achially being Novices. 
Question C is considered n good Journeyman question; D is re¬ 
jected. Note, however, that passing of D means tliat a man is 
practically certain to be either Jouvneymun or Expert while pass¬ 
ing C gives a much lower probability. The same is true for failure 
on tlio question. E illustrates the sort of question discussed in 
the prccediuK parsigi’oph. A man passing this question is four 
tiine.s a.s likely to he an AlJpi*entice as he is to he a Novice, while 
ho IS only two and a. half time.'? n.s likely to be a Journeyman as 
an Apprentice. Nevertheless, this question ia considered a Jour¬ 
neyman ciucstion simply because the curve rises more sharply 
It tiiut level. 

Ill c’onchuliug this discussion of the Army procedure a word 
Ji to be said regarding the satisfactory (on the whole) results 
)l)t:iiued. Two prime requirements for Army trade tests were 
*poed of production and simplicity of administration. Ihose re- 
iuirements were met by the technique v^sed. Any slight gains iu 
icciu'dcy Ltiat could have been inade through more refined staLis- 
deal trcutnieiiL, it may well be argued, would not have been worth 
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the trouble. The fnirly Rood results that wore obtained by rough 
methods were in part due to the following considemtiona; (1) 
Questions were combined that did show good dilTercntintion at 
the several trade levels. The dilYcrentiation was aati.afuctorily 
shown by the inexact metlmd for the reason that ordinarily very 
good differentiation occurred at only one cUus.a division and this 


division point could be detected by merely notinR the rise in the 
curve, Hence good roaiilts were secured though it aoom.s reason¬ 
able to believe that the same quality of rcaulta might have been 
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obtained with shorter tests and less waste of questions. (2) Since 
a fairly large number of questions was asked, the crror.s made in 
crediting separate questions were likely to be compensating. 

The conclusion that the Army method of evaUintiiig questions 
was at fault and that the practical choice of que.stions was to some 
extent adversely influenced by the statistical method utili/ed 
appeora to be jiistilied, The question at once arisoa whether a 
more satisfactory trade test method can be built, using the sort 
of statistical foundation we have outlined. The remainder of 
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the pfiiocr \vil[ be clcvotod to some tentative suggestions for a 
ty|)e of trade test which does make use of the method presented 
for the evaluation of single questions, and which will tit the same 
time have ccrLaiji advantages as compared with the Army tech¬ 
nique in the manner of the combining and using of questions, 

The Army tiriil trade test consists of a fixed list of questions with 
norma oatabli.sliod for the total list. A method of test construction 
which would make possible the treating of individual questions as 
fltaiuJai’dizc'd units, in place of having the entire test as the stand¬ 
ardized unit, would have decided advantages in point of practical 
usefulne.ss. Among the advantages are: (1) The test may be 
made more brief when desirable. (2) It may be varied to prevent 
coaching and to allow for unusual circumstances. • (3) In test¬ 
ing the examinee it is unnecessary to give questions of all de¬ 
grees of difficulty; that is, questions less difficult than those already 
passed noe<l not be given, nor questions more difficult than tho.se 
already failed. (4) The test may be continually developed by the 
incorporation of new questions, standai'dized in connection with 
the n.se of the exi.sting questions. (5) Questions which prove 
nnde.siralilc for any reason may be dropped without nece.ssilating 
any change in the remainder of the test. 

In addition to these practical advantages listed, a system of 
trade test construction based upon the theoretical discussion in 
Part ir, would have a more logicai statistical foundation than have 
Army trade tests, 

Wliat, now, are Uio difficnlties in the way of a new trade test 
molhod of 11)0 sort we have been pointing toward? Is it possible 
for us U) lay down some definite suggestions as to the form of a 
trade test built on the single question basis and to outline a mode 
of procedure? The answer is that there exists one moat formid¬ 
able obstacle, namely, the absence of a sound method for com¬ 
bining the ve.suUs from the single question.s, Concretely, how 
shall wo cQinbiiio the ratios showing the odds in an cx.ample such 
a.i the following? Let ns say the applicant is given five questions, 
three of which are passed and two of which are failed. We have 
the following odds from the several questions: Question 1 
(passed) shows that his chances of being Apprentice rather than 
Novice are 9 to 1; question 2 (passed) shows that his chances of 
being Journoyman rather than Apprentice are 7 to 3; question 
3 (failed) shows that his chances of being Expert rather than 
Journeyman are 2 to 8; question 4 (passed) .shows th.at his chances 
of being Journoyman rather than Apprentice are 8 to 2; and 
question b (failed), shows that his chances of being Journeyman 
rather than Apprentice are 3 to 7. What, now, are the probabil- 
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itieg that this individual is n Journeyman^ judgine on the basis 
of all the questiona? 

The usual way to combine probabilities in answer to such a ques¬ 
tion is to multiply the ratios, Thus, in coin tossing, for example, 
the chances that one coin will come up henda is 1/2; the chances 
that two coins will come up heads at the same time is 1/2 x 1/2. 
Applying this sort of method Lo the above example, we would 
obtain the combined odds from the five (]UC.sLions by multiplying 

0x7x2x8x3 9 

the ratios given. We would have, that is-—. 

Ix3x8x2x7 1 

But this gives false results. This multiplying of iirobabilitlos is 
based upon the assumption of inclopendenco (lack of correlation) 
between the several cvent.s, However, the pn,s.sing and failing of 
particular trade questions is clearly not uncorrelatcd with the 
passing and failing of other trade ([uostions, It might appear 
at first that we could correct for the intercorrelation.s among 
questions by means of the partial correlation procedure. This, 
however, is impossiblo because of the inapplicability of the partial 
correlation method in the case of ncui-liucar rcgressiou.s. That 
the regressions of trade questions are not linear waa clearly dem¬ 
onstrated by Army experience. The writer Iciiow.s of no way by 
which this problem of combining probabilities from ilitYovent trade 
questions can be handled mathematically. 

Wc apparently, then, are forced into a position where we miust 
either abandon Llie proposed sort of LiMide test or find some make¬ 
shift for combining que.stions. We shall brielly state one or two 
tentative sugge.stions in the latter direction. An empirical ])roce- 
dure for combining individual que.sLions, even though it fall far 
short of what would be theoretically dcsivahle, may nevortUeloss ho 
sufTicieiitly valuable to warrant the u.se of tin? propo.sod .sort of 
trade test, 

Wo shall mention two possible lines along which an empirical 
procedure might bo developed. The es.sentinl rcquiremeiiL is that 
due provision ho made to guard ngidnst the use of many closely 
intcrcorrelated questions in the examiniiLion of an individual. 
This may be accomplished either (1) l)y clns.sifying appropriate 
questioms into fixed groups placed at several levels of didkulLy 
(analagoins to Ilinet age groups), or (2) l)y having at each level 
a large number of qiiestion.s which are .sorted into classes of (lue.s- 
tioii.s having rehUivoly low correlations with ([uestion.s in other 
classes. 

The first of the.se suggested pos.sihilities lias .s(nm>, hut not all, 
of the advantage.s earlier nieiitioncd a.s cluiraeteri.sLic of a test 
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which would flexibly combine single standardized questions. In 
this method \vc would have a compromise between the standardized 
single question and the standardized complete test. Here, the 
whole group of questions at the Apprentice, Journeyman, or Ex¬ 
pert, level must be treated as a unit. This trade level form of 
teat, while somewhat similar to the Binet age level method, has 
several significant difVorence.s. Among these are the following: 
(1) Questions are placed at the level where they difTerenLiate 
beat, not where a certain per cent of the individuals tested have 
pas.scd, (2) Questions are weighted in proportion to their cliffer- 
cnLiating value; i. e., on the ba.sis of the probability ratios earlier 
discussed. (3) Qiic.sLions are weighted dilTevently if passed and 
if failed. (These modifications would appear to be a])plicablG to 
nge-lcvel tests like the Binet as well as to trade tests.) 

The second suggestion of n procedure for trade test construc¬ 
tion 1ms certain advantages over and above those of tlio fi-xed 
trade level grouping just considered. It is essentially the same, 
save that greater flexibility is introduced in the use of questions. 
It carries very much further the idea of alternative te.sta which 
have been placed at some of the age-levels in rcvi.sed Binet tests. 
In place of having a fixed set of questions at, say, the Journey¬ 
man level, we have a great many questions. These are classified 
according Lo tlie divisions inlo which trade knowledge in this trade 
has been analyzed. In examining a candidate, the questions 
which are asked at u given trade level are chosen from the 
several classes into which the questions at that level have been 
disLriljuted, This method appears to be a feasible empirical de¬ 
vice Lo jirevent a candidate’s being judged upon his answers to a 
non-i'opre.sontuLive and highly intercorrelatcd set of questions. 

We shall not enter into a description of the detailed methods 
of weig-hLing, scoring, nnd combining scores, which would be used 
in the suggested procedure. Suffice it to say that the acLiuil pro- 
bnbilitic.s calculated for each question can be transmuted into 
simiilo "wciglits" (con.sisting of numbers proportional Lo the lo- 
gaiiLhnis of the ratios of odds) which may then, at each level, be 
readily added. The sum of the "weights", regardless of the 
number nf question.s .'isked, will give a rough indication of the 
odds that the candidate is at that level or below it, based upon all 
the qiic.sLicms asked nt that level. The questions arc, of course, 
in this way being used as though they wci'c not intcrcorrelated, 
For adding the logarithms is equivalent to multiplying the ratio 
and this is the Ihcovotically con-ect method of cominning pro- 
babililie.s when the events are uncorrelated. The composite pro¬ 
bability that we got is, therefore, only a very rough approximation, 
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But inasmuch ds the questions have been clflsglfieil into groups 
not closely corvelated with qucstious in othcv grouiis, awl inasmuch 
ns the combined probabilities will be thrown ofl’ in about llie sumo 
degree and in the same dirucLioii for all cnndidntes, the procedure 
appears to be usable. We again enipliaswn, however, that the 
nielhod is ofTcred only as a tentative suggeation, a iniilcesliift pro’ 
£cdure which may have advantages over the rigid type of Army 
trade test. 

IV. 

Wc may briefly siiminurUc ns follows; 

1. The statistical procedure used in building Army trade tests 
appears to be open to criticism on the grounds tliat Elie regression 
of teat score on trade status wns used in place of tlie reverse rein- 
tionship. Closer consideration reveals, however, that tlic regies- 
sion relations which were calculated were not used as such, 

2. In order to make clefti the indirect use of the figures cal¬ 
culated in evaluating each test question, wu liave outlined, without 
referencQ to Army procedure, n logical ba-sis for evaluating questions 
in terms of the probability relationships of trade status to scores 
on single questions. 

3. The Army method was then compared with our discussion 
of n method which would use mathematical odds for each question, 
and the conclusion was reached that to a ccrUiii extent Llio Army 
procedure wns actually comparing such percenLiige rntio, but not 
in a logically correct manner. The method ii.sed worked tolerably 
well, but, ns shown by a few illustrations, it also foiled in port. 

4. Finally, we hove attempted to suggest linos whicli n did'er- 
ent technique of trade test construction might follow, based upon 
the theoretical diacussion contained in the paper. The principal 
advantages of the proposed sort of tost are indicated aa well as 
the special di/Rculties involved. 



A CASE OF SECONDARY MENTAL DEFICIENCY 
WITH MUSICAL TALENT 

By Blanche M. Minoguc 

Befove incclicinc and paychology had advanced to their present 
degree of development, the obviously defective in intelligence were 
regarded as being possessed by some superior power, The occa¬ 
sional ‘'idiot-savant’' with his extraordinary abilities must have 
seemed convincing proof of thot theory. Modern psychological 
methods, however, enable ua to understand to some extent these 
heretofore inexplicable creatures. In recent years several cases 
hnvc been reported in considerable detail. They are usually moder¬ 
ately high grade defectives who possess special abilities, which 
stand out in startling contrast to learning ability, judgment, etc., 
which are noticeably below the average. 

Among '‘idiot-savant.*;” are occasional musical geniuses who are 
almost phenomenal. Although musical genius in itself is appar¬ 
ently something apart from general intelligence, it involves many 
■of the attribute.*? of intelligence. For this reason a case of marked 
musical talent combined with low general ability is the move 
rcmnrlcoblc. Such a case is that of a male patient, at Letchworbh 
Village at the present time. 

X. Y.| a twenty-thi*co year old boy, with a mental age of about 
seven years, is a pianist of marked ability. He has been in the 
institution for several years, and in that time has played at 
practically all of the social functions of the institution. 

The family history seems free from any intelligence defect. 
The paternal line is of normal, if not superior, mentality. The 
father's father was a broker, and one cousin, an engineer, has 
been a successful inventor. The father*, born in Hungary, earns a 
moderate salary as a shipping clerk. The father’s mother is a 
pianist of exccptionol ability. His sister’s daughter is also an 
unusually gifted pianist. The other members of the family, in¬ 
cluding the father himself, show musical ability in moderation. 

The maternal line is intei’esting. The mother, also born in 
Hungary, is a woman of superior intelligence and refinojnent, The 
entire family appear to be of more than average mental ability. 
•All have achieved success in business. One brother has two 
children who were pronounced superior after a psychological ex¬ 
amination. This branch of the family shows considerable emotional 
instability, and does not give any indication of musical talent. 

The patient's sister is a very bright, attractive young woman of 
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about twenty-one years. She graduated from high school, winning- 
recognition for her scholnrshp. At present she is worlcing and 
carrying collega work in Extension School. She is u violinist, but 
does not show unusual talent. 

The patient was born in 1900, in the United Slntc.s. Everything 
connected with pre-natal life was favorable. Birth and infancy 
■were normal. He wn.s a bright, healthy child, walking at twenty 
months and talking nt one year. As soon ns lie talked lie learned 
little songs in English, Gernian, French and Hungarian. lie learned 
quickly and appeared to have intelligence, a.s well as nui.sical 
ability, far above the average. Even in infancy, however, the child 
had periodic attacks of temper. His mother describes him ns very 
amiable until some emotional experience such, as suvpvi.se caused 
a sudden passionate outburst. 

The boy developed normally until the age of three years. At 
that time ho was .severely ill with pnouinonia, with complications 
which have since been diagno.sed as meningitis, In the delirium 
of the disease he sang incessantly the songs he had learned. 
For many years after his recovery he showed groat reluctance to 
sing. After this illne.ss the child frequently Imd violent screaming 
spells and soon showed mental retardation. When seven years 
old he was taught at home for a year by a special tenclier, and 
then entered grade 2A in the public .school.s, He made fair pro- 
gre.ss in rending, writing anil arithmetic, but wa.s teased so unmerci¬ 
fully by the other children that ho had to be removed from school. 

He received piano instruction for two years under excellent 
teachers but was very abusive to them. As he became older he 
often became voluble on the streets, and attracted crowds of i)CoplG. 
He became the victim of un.scrupuloti.s por.sons in the neighborhood 
and BO was committed to Letchwovth Village. 

Since admission to the in.stitntion X, has not been a discipline 
problem. He does light work around tlie cottage, and plays the 
piano much of the Lime. As he is not very robinst he requires 
sleep during the day, He lacks many characteristics of the feeble¬ 
minded. His muscular coordination is very good; he walks 
briskly, without the usual shuffling gait of the mental defective. 

X, takes great pride in hi.s nui.sical accompli.shmeut.s. He plays 
the most dilTicult music by sight and by ear, Ilis ability to render 
classical and concert pieces, ns well as the modern “jaz/.,” is note¬ 
worthy. In n recent te.st before a woman of considerable musical 
training he played the Anvil Chorus from "11 TrovuLoro,” Lohen- 
(fyi)i, the Tannhau.ser Hlarcli, Tamnlella, Carmen, Chopin'.s Fun¬ 
eral March and many other classics. He read at sight the Marche 
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Grotesque by Sinding, Chaminadc'a The Flatterer,, and Heart’s 
Melody by Engelman. He then accompanied the phonograph in 
playing Humoresque and the Blue Damibe Waltz, and had no 
dilTiculty in aelocting the right key. He also read at sight the 
accompaniment for a vocal soloist. His emotional instability 
obviously has an unfortunutc effect upon his playing, but he plays 
accurately and with feeling when hia attention is focused upon 
his music rather than upon the admiration he is exciting. The 
iiiuaic instructor at the institution considers his technique very fine 
for his limited period of study. His pitch discrimination is 
romarlcable, and hia tonal memory unusually good. Hia sense 
of rhythm seems to be more affected by hia emotional state than 
are his other abilities, and consequently ia more variable. The 
most important single factor in the boy's talent seems to be his 
memory. For time, for places, for events, for any composition 
ever learned, he has a memory almost phenomenal. That he 
has kinaesthetic moinory also, is evidenced by his habit of playing 
without looking at the piano. His ability to imitate is considerably 
beyond hia mental age. In the Knox cube teat he made no failures. 

UnforLunatoly, tlii.s patient is deteriorating mentally. On his 
admission to the institution in 1914, age foui-teen years, his intelli¬ 
gence quotient was ,G2, at twenty years of age, his I. Q, was ,54 
(mental age eight years and six months) and a recent test gave 
him an I. Q, of .46 (mental age seven years and five months) by 
the Stanford Revision of the Binet-Simon. In this last test his 
basal year wii.s four. At Die five year level ho failed the "patience" 
test, anil in the aixLli year passed all but the mutilated pictures. 
At tile .seventh year he foiled to give differences and received only 
half credit for tying the bow. At eight years he failed the ball 
and field and the comprehension tests, and could not count back¬ 
wards, At nine ho knew the date, could make change and give 
rhymes. The subject failed all tests at the ten year level. The 
groate.st deterioration appears to be in comprehension and judg¬ 
ment, At present he seems to fall at about the six year level iit 
tests of tlie.so functions. In Burt's reasoning tests he made a 
score of 1.75, giving him a rating just below the seven year level. 
Ills score in the Indiana University Primer scale was 42, (the 
median for six year.s is 43.3). He was unable to go above the 
fiftli year in Die Portcus Maze tests. 

Emotionally, this boy is excitable, egocentric, usually cheerful 
and obedient, but vei’y sensitive and wholly incapable of a social 
oxisLence. lie (loc,s not mix iviLh the other boys, and leads a life 
really iijiart from tiiem, altliough one feels that he craves comrade- 
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ship, but does not know how to get it. 

There ni’c two particularly intereating featlii'os of liia talent. 
One is hia faihii’e to produce any original composition. This may 
be the result of defective intelligence. The other is hi.q inability 
to learn to dance. He seems lo have no comprehension of the 
relation of the musical rhythm to hia own movements, Thia np’ 
parently is not dependent on intelligence, for many low grade 
defectives are CTCCcllcnt dnnccra. 

The study of this case is by no means n complete one but it 
serves ns one more bit of evidence that niiisicnl ability ia a thing 
apart from "general intelligence.” It is interesting that the 
disease which robbed the child of his horilngc of intelligence and 
increased his emotional instability, left apparently intact thia 
special talent, It is perhaps purely n matter of chance tliat lie was 
left with one intellectual trail, his unusual memory, uninijinired, 
This fortunate combination of memory, scn.se of rythm, pitch dis¬ 
crimination, etc,, makes a striking talent. Wore any one of thcae 
lacking, or destroyed, the whole gift would go with it. 



the FRANZ DOT TAPPING TEST AS A MEASURE 
OP ATTENTION' 

By Irene Ciiae Sherman 

In his "HnTulbook of Mental Examination Methoda"’ Dr. Franz 
de.'scribes varioiia tests of attention, nmonff them a test of the per¬ 
formance of nccurnte movements. Cross section paper (2 or 4 
aciunres to the inch) is used; "The subject is instructed to tap in 
onch square as vnjiidly as podsible, goine to and fro.'“ The experi- 
mentor notes the tiino for the taps along the particular iines. The 
te-st may he made with 300 squares, 20 squares to the line. 
Emphasis is placed neither upon accuracy nor upon speed, since 
the aim is to discover variations in attention. 

In n por.sonnl communication Dr. Franz advised the use of 10 
squares to the line with 30 lines for children. He states that the 
individual sets his own speed, but is expected to keep up the same 
speed throughout the test. With a speed not the maximum the 
rntc can he kept up constantly with a variation of not more than 
10%. He liolieves that the lest shows ability to keep up progressive 
work, and al.Ho indientea "sLick-Lo-it-neas." He also points out 
that the Lest .sliows the relative performance of the individual at 
(lin’c'ixmt 11)110.4, nnd docs not g-ivc a comparison of different 
individual.s. 

Ill an ofFoi’t to find tm acciimte means of measuring fluctuations 
of uUenLion in children, this test, with a number of so-called 
nlLcntion tests, was given to 172 miselectcd cases'. Cross section 
liaiior four .miuares to the inch was used, with ten squares to a row 
in !i series of thirty rows. The instructions to the child were, “Put 
a dot in each of these squares, beginning here and going across 
to here (examiner indicated the distance of the ten squares), then 
coming Ijack on the nexfc row, and so on down to this line (indi¬ 
cating the base lino which marked off the thirty rows). Do this 
as fast as you can, but be aui’« to put a dot in each square, and 
don’t misa any squares." The time for completing each row of 
squares wns taken, 

The re.sultJi indicated such a wide variability of performance in 
children that it was felt to be necessary to establish a more 
accurate norm than the 10% variability suggested by Dr. Franz, 

‘Dr. Ii’niiix iloi'H not immc llils tvst, but the writer feels "Dot ITapplne" 
Jw JiitJHl ilr.sfi'Jpl In- itf H. 

*I'’rnnZ| Slii'plii'i'tl Ivory, Jlanifbool: of Menial E^iiinlnullon Mclhoda, The 
MiicMlIliui t’dinpuiiv, 1U20. 

’JllJd. 1*. .SO, 

'liistlUile fdi' .Tnvt'nlle lloHuarcli, Chlcugo, Illlnola. 
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provided the results would lend themselves to such a standordi- 
zntion. 

Each child was graded by the Stanford Hcvision of the Binet 
test, so that a mental nge and intcUigence quotient was available 
in each ease. In each case the arithmetic mean, the range and the 
average deviation of time were taken, ns well aa the coelTicient of 
variability. In order to discover the influence of nge, mental age 
und intelligence rating upon performance in the test, the results 
are arranged according to these three factors, and arc presented 
in tables I, II and HI. 

Table I indicates that thcr’o is n general decrcaae in average 
time, avei’Oge range and nveroge deviation with increase in 
chronological age. This decrease, however is not sufficiently regu¬ 
lar to make the chronological nge a basis of standardization of 
performance, and is no doubt due to the increase in speed due 
to better motor co-ordination which develops in advance in ago. 
The coefficient of variability showed on even greater variability in 

TABLE I 

lUJ.ST-'f/rS ACCOKIMNU T(» CimoXOl.dOICAI/ A(}ic 


Age 

Average 

Time 

Average 

Range 

Average CoelTicient No, of 
Deviation of Cases 

7-Q 

11.27 

13.0 

2.2C 

VnrinbiliLy 

19 

0 

8-0 

12,78 

8.0 

1.06 

14 

7 

0-0 

7.86 

7.2 

1.37 

IB 

16 

10-0 

C.84 

C.C 

1.17 

10 

20 

11-0 

6.72 

6.1 

.98 

13.6 

19 

12-0 

6.G2 

4.9 

.92 

10 

21 

13-0 

6.G5 

6.1 

.99 

17 

23 

14-0 

3.96 

3.4 

.6 

12 

26 

16-0 

6.10 

3.0 

.70 

11,G8 

15 

16 + 

6,11 

3.7 

.77 

16 

17 


TOTAL 172 

relation to age, so that it indicates no relation between variability 
and chronological age. 

Table II shows the same tendency Cor average time to decrease 
with increasing mental age, the average range niul Eivornge devia¬ 
tion also show this decrease, but not to such a mavlced extent as 
average lime does. While this decrca.se in average lime is iiuitc defin¬ 
ite, yet tlie differences between any two mental ago.s arc too sniiill 
to moke the average time a basis of scoring in toi'in.s ()f mental 
age, The coefllcient of variability, as in the case of chronological 
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age, shows great variation, and no relation to nental age. 

Table III indientea that none of the measures showed any rela¬ 
tion to intelligence quotient. 

Table IV and graph 1 give the distribution of the coefficients 
of variation for the entire number of cases. The median coefficient 
is and the inter-quartile ranges from 11 to 18 inclusive. 

That 1a, fifty per cent of our cnscs have o coefficient of variation 
between 11 and 18. A score falling between these numbera, then, 
indicates a noi’mul performunce in this teat. The upper quartile 
langca horn one through ten, and any score between these numbers 
would be conaidered an excellent performance in tliia test. A 
score of nineteen or above is considered to show a fluctuation of 
attention greater than that shown by fifty percent o£ our cases. 

Graphs 2, 3 nnd 4 illustrate the increased variability of perform- 


ance of 

individuals with 

a cocITicient of variability above 18. 

The 

time is 

more variable in subjects with 

a high coefficient, and they 



TABLE II 





lllOSTTLTS ACCOUIUKG TO 

MENTAL A(JB 


Age 

Average 

Average 

Average Coefficient No. of 


Time 

Range 

Deviation 

of 

Cases 




Variability 


5-0 

!).17 

6.0 

1.16 

13 

1 

0-0 

13.52 

10.3 

1.98 

16 

11 

7-0 

10.45 

13.7 

3.17 

23 

10 

8-0 

6.97 

6.2 

1.01 

14 

26 

9-0 

0.31 

6.3 

.97 

16 

28 

10-0 

6.42 

6.6 

.89 

IG 

32 

11-0 

4.DG 

3.0 

.63 

14 

14 

12-0 

4,86 

3.3 

.67 

14 

15 

13-0 

4.09 

2.6 

.43 

11 

14 

14-0 

4.03 

2.8 

.43 

10 

7 

15-0 

4.9.5 

4.1 

.89 

17 

4 

lOH- 

3.56 

2.0 

.34 

10 

4 

TOTAL 




172 



TABLE III 




TIRKTtT.TW ACCOllDIKG TO INT13I,LIGBNCE 

QUOTIENT 


I.Q. 

Average 

Average 

Average 

Coefficient 

No. of 


Time 

Range 

Deviation of 

Canes 





Variability 


50 

7.0 

5.9 

1.6 

15 

9 

GO 

7.1 

6.6 

1.3 

17 

23 

70 

6.G 

6.4 

1.0 

16 

41 

80 

8.4 

6.8 

1.2 

14 

43 

00 

6.3 

7.4 

1.2 

16 

26 

ion 

6.0 

3.6 

.6 

11 

20 

llO-H 

4.9 

4.0 

.7 

12 

10 


TOTAL 


172 
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TABLE IV 

DISTnillTJTION OP COKPPICIBN'rS ()C* VAIirAniUTV—172 C'ASlCfi 


0- 1 . 1 

1- 2 .. 1 

2- 3 . 2 

3- 4 . 1 

4- 5 . 2 

5- 6 . 3 

0- 7 . r> 

7- 8 . 8 

8- 9 . T) 

9- 10 . 12 

26 percentile 10-11 . IG 

11-12 . 12 

12-13 . 12 

Medifiii 13-14 . 13 

14- 15 . 8 

15- 10 . 8 

16- 17 . 12 

75 percentile 17-18 . 13 

18- 19 . 7 

19- 20 . 9 

20- 21 . 5 

21- 22 . 3 

22- 23 . 0 

23- 24 . 8 

24- 25 . 3 

25- 26 . 3 

2G-27 . 0 

27- 28 . 1 

28- 29 . 0 

29- 30 . 2 

30- 31 . 0 

31- 32 . 0 

82-88 . 0 

33- 34 . 0 

34- 35 . 0 

36- 36 . 0 

30-37 . 1 

37- 38 . 0 

38- 39 . 0 

39- 40 .. 0 

40- 41 . 1 


•equire on the whole a greater length of time to complete the 
est than subjects with average cocIRcienls. This difTerence is 
nore niarlced in the cnse of the average deviation, where tlic 
nensures are greatly dispersed for those coumcionts above 19, 
vhile those below 18 show a central tendency around a low 
ivevage deviation, The mode for those making an excellent 
icore (3-10) is .1 while the mode for the average group is soino- 
vhat higher, namely .7. The rntige of lime liilcen on the test is 
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ilso hiffbor foi’ Iho.sc with coc/TicJcnls nbove 18, being more widely 
Jistribiitucl than the mcnsnrcs for the lower coeflicients, which as 
in the case of average deviuLion, show a marked central tendency 
mound a low set)re. These graphs clearly sliow that a high 
coeOlcicnt oC varhibility is accompanied by increased total time 
of pcrlovinancc, increased range ot time from line to line, and in¬ 
creased (Icviation from line to line. Since it has been shown 
above tluiL Llio coelVicicnl of variability ia independent of age, men¬ 
tal nge unci intelligence quotient, it may be assumed that the 
variability of the coofTicient is due to some other factor, presum¬ 
ably fluctuations of the attention. 

Graph 0 illu.sLrutes the typical kinds of performance on thin 
teat, Tlio first curve has a coefficient of variability of 4, v/hich ia 
superior performance. The overage time is five seconds, with 
long periods of no variation from this average time; there are 
no great deviiiLious from the average from line to line, and the 
total range of time is only two seconds. The second' curve is 
that of an average performance, with n coefficient of variability 
of 14. The average time is also five seconds, but there are no 
long peribd.s of unvaried performance, although on the whole 
the deviations are slight. The total range of time, however, is 
five seconds. Curve three is a curve typical of a high coefficient 
of variability, in this case 20. The average time here is 13 seconds, 
will) no periods of invariable performance. There are constant 
deviations from the average from line to line, with Q wide total 
range of time, namely, IB seconds, 

In the giving of the tests it was often noticed by the examiner 
that children frequently varied the. size of the dot, began making 
circles, heavy dots, two dots in one square, etc. This was often 
interpreted as due to low chronological or mental age, or to low- 
general intelligence. Since the results showed no relation between 
these factors and the coefficient of variability, a study of the dot 
patterns wns made. This revealed that the variability of the 
size of the dots had little relation to the score. Subjects who 
changed from a large dot to a small dot, or vice versa, did 
not necessarily make a poor score. In fact, many cliaiiges in 
the size of the dots occurred with no change in time from line 
to line. On the other hand, many subjects who made very 
poor scores sliowed a marked regularity in the size of dot. In 
only one case was there a definite isolation between size of dot 
find incrensed lime. This case, scoring 18, had a marked 
increase in time in two lines, with a change in dots in these lines, 
making circles instead of dots in these two instances. On the 
olher hand, of six cases showing lines with marked increase of 
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ime with increase In size of some of the dots in this line, all of 
hese cases also had other lines with increased rate of time and no 
hange in size of dots or other variations. While it is poaaible 
hat n change in the size of the dot may menn n shift of attention, 
t is almost inpossible to say definitely that this is true, because 
if the large number of casea in which there was no evident re- 
ation between time and size of dot. Ghangca of time are just as 
ikely to occur where there are no changes in size of dot as where 
here are such changes, and on the whole these changes in size 
if dot are considered ns insignificant compared with other un¬ 
mown factors which are producing changes in attention. In fact, 
t is believed that these changes iti aiz.c of dot nve but one of the 
xternal manifestations of the variability of attention, relatively 
inimportant, since they seem to influence the total scoro very 
ittle. 

The records of the cases were analyzed in order to discover, if 
lossible, any factors in the subject which might cause, or be cor¬ 
elated with unstable attention. Because of the subjective nature 
if the analysis of the individual cases, with the marked lack oi 
orrespondence of descriptive terms used in the variou.*? records 
n presenting the history and mental analysis, a limited number 
if terms were arbitrarily selected ns possibly having Esome ro- 
ation to attention. In cases designated n.s negntivo none of theae 
ieacriptive terms ocebrred. 

In Table VI the individuals ore classified under the descriptive 
erm which most nearly described them; the percentage diatri- 
lution is given according to coefficients of variability. The table 
hows that the smallest percentage of indivldunks with a negative 
listory occurs in the group with scores of 19 or above. This same 
:roup also showed a larger percentage of '‘irritability,” “distract- 
bility," “incoherence,” and marked “slowness of reaction” than 
lid the other two groups. Subjects described merely ns nervous 
.nd restless were found not to show poor attention as mensurod by 
his test, It was also striking that individuals de.scrlbed as being 
loor in attention by various examiners or other observers in the 
lome or school were not characterized by making' an unusually high 
core, 1. e., B% of these subjects made coefflcient.s from 3 to 10, and 
Ikewise 6% made coefficients of 19 or above. Similarly, aubjecta 
vith organic brain disease or psychoses were not characterized by 
^ high score. Rather, the larger percentage of these were found to 
nake an excellent score, namely 3 to 10, and were able to sustain 
ittention over a short period of time, such as ia demanded in tlila 
esL 
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Cocdlclcnl 

of 

Vftrln1)lllly 

3-10 

11 -ia 

19 + 

Cooincioiit 

of 

Vrirliililllly 
3-10 
11-18 
19 + 


TABLE Vt 

PIinCENTAClE nrSTUIBOTION OP TYPE OF CASH 
ACCOJlDlNCj TO COBPFICIKNT OF VAIlIADILiTY 



Poor 

Altontlim 

MervnuB 


IlypereotWe, 
Dlstrnctlble 
Irritable and Flighty 

Nfftnllvi! 

anri 

IlealloaB 

Unxlnblc 

‘12.1% 

6.3 

18.4 

7.9 

2.0 2.60 


3.2 

9.6 

1.0 

fl.6 3.21 

2S,2% 

llninlilInK 

(irid 

6.0 

12.8 

7.7 

12.fl 7.70 


2.G 

0 

G.l 


Slow 

Apathetic 

Psychotic 

No record Total 

2.6 

6.3 

7.9 

2.6 99.0 

0 

tZ.Q 

2.1 

8.4 lOO.fl 

7.7 

6.1 

2.6 

6.1 99.9 


CONCIiUSlON 

WhilR nvGvnffe time, rRitgo and deviation decrease with increas¬ 
ing ehroiiologicfil nnd mental age, this decreosc is not suffleiept 
to iimke chi’onologicRl or mental age a basis of standardization, 
since tJie incrense is firobnbly due purely to increasing motor 
eoordinntion which develops with increasing mntui’ity. The better 
porfornumce witlj increasing age, then, is not due to better con- 
troliccl nttontion, since the variability of performance as nieeaured 
by the coelTicient of variability shows no relation to age. 

There is no relation between performance in this test and In- 
tulligeiico quotient. Viiriability on the teat ia due to some factor 
other than maturity or general intelligence, presumably fluctuation 
of nltenliuni 

Tlic intci-quavtile range of cocflicienta of variability for this 
group of 172 unselecLcd cases was H-18. A score within this 
range is cou.sUlcred average performance. 

A high coelHcicnt of variability is accompanied by increasing 
total time of performance, increasing range of tirpe, and increas¬ 
ing deviation. 

Among cases showing a high degree of variability (score of 
19-I-) there was a greater percentage found to be “irritable,” “dis- 
tractiWo,” ‘'incoherent'’ and “slow in reaction.” Subjects described 
merely ns “nei'voiis and restless” were found not to show poor 
attention as measured by this test. Performance on the test 
showed thixL children described by observers in the home or 
school ns inattentive did not necessarily make poor scores on this 
test, Observed inattention in these cases is evidently not a real 
lack of ability to attend, but is expressive of some other factors. 

Similar results were reported in a recent article^ on posfc-en- 
cephaiitic children, where it was found that, although those cases 
were described by observers as inattentive, by tests they proved 
capable of sustained attention. The writers concluded that Iti 
their cases the apparent inattentivencss was the result of emo. 
tioriat disturbances®. 


“Rhcrmnn timl Ui-vorly. The I'aetor nt OrtrWoraHojt Cftlfdrcii Stoicdip 
DigIciiUlCH {•'olloioJiig BpWfJwto JIhiocpftainii. Art'll, oC Nonr. & 
I'svdi,, voi. HI, pp. a2o-a4u. , ,, , / i.,. „ „ 

'■Tlio wrUor is Indebted U> Myrtle Rnymaker Wortfiffiffton foi- nssistanr.o 
In prc>pnrntlon of ihe dntn. 



N ADVANCED COTJUSE IN EXEEUTMENTAL. 
PSYCHOLOGY APPLIED TO ADVERTISING’’' 

By A. J. Snow 

NorLliwestorii University 

It is obvious that the tenchinp ol lulvertisiiiK -without an ex- 
riiuoutal laboraloiy is just aa futile ns tenchiiiK- civil enKincering 
thouL ii Tiolfl coui’se in surveying. However, tborc is ii vital 
Terouce beUvee-n Uie two: in the \nUcr case an cn},'ineevitig 
idenL can check up the correctness of his auvveyini? with the 
1 o£ nmUiematical compulation; while in the ense of psychology 
applied to aclvcvUsinK the student, nt the present, cannot 
I'ify his theories except by reference to a purchasing public to 
lich he has usually no access. Nevertheless it is perhaps pos- 
ilc to bring this contact about—beUveen the student of nclvcrtia- 
j and the purchasing public—by n coopeimtivo plan on the part,, 
the advertiser and the university. 

Obviously a student who would profit by such a cooperative' 
rangement cannot bo a beginner in the field. It is vital that 
should have some knowledge of the fundamentals of advertising- 
fore lie is admitted to such a course. It has been our policy to 
tke the following prerequisites for the course in experiinentnl 
vertising; otic semester of general elementary psychology, one 
marketing, and another semester in psychology ns applied to nd- 
I'tising. Wg arc hoping that, in the last-named course, the student 
U become familiar with the application of psychological principles 
the general field of advertising. To accomplisli this end, the 
ident is asked not only to rend published material and listen 
any new ideas brought out in the lectures, but also, as part 
his home work, to criticise advertisements, select samples 
advertising illustrating good and bnd applications of psychologi- 

1 principles, or lack of application, discover modern tondencicB 
d solve any problems which were formulated by the instructor 
• the purpose of applying psychological principles to advertising, 
me of these problems were of the following nature: one such 
oblem Was aa follows—Explain why advertising is limited to 

2 use of only two of the four possible ways of producing 
Mention. Illustrate. Por the second example talce the case of 

Illinois farmer who -wishes to advertise in the weekly news- 

Hi’hO \]itiiro iii(‘ niiiiuul incciniir oC Tlio Niilloniil ANsurlalInn of 'i’puclicrH 
AdvcrtiHiiiK tnoctliip wllli Tlip AHsocliilcd A«lvi'i'liKiitK (.'IiiIib ijC lIio World,, 
nnlic City, .rime (1, 
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pnpevH in oi-dor to market by express some new potatoes direct 
to the eor-».siunei’. Tlireo good papers arc available, each covering 
din'ci-eiit territory. A Cull page of space in any of them would cost 
lULy dollars, .similler space in proportion. How can the farmer 
most prolitrihly si)end fifty dollars in advertising in a given week? 
Why? lloi'c i.H .still another problem—An adverlirdng man lost his 
job, till! reason iieing that he arranged for an advertisement to 
appear every other mouth in a monthly magazine. The excuse he 
gave was that the ajuiropiuaLion was limited to the cost of only six 
issuoa. Why dill Llii.s aclverti.sing man get the worst of it? 

When n student has successfully completed this comparatively 
elementary course in advertising he can, in his senior year, or 
while pursuing graduate studies, elect the advanced course in 
cxpei'iincntal psychology applied to advertising. He can pursue 
this course either one or two semesters, gaining academic credit 
proportionnLoly to the work done, but not exceeding five credit 
hour.s during any one semester. The students in this course meet 
twice a week in one hour sessions for discussion and twice a week 
in three hour scs.sion.s for laboratory practice. 

The course itself is divided into two parts—individual problems 
and class problcm.s. The first part—individual problems—is 
divided further into two parts, the division being based on the 
individunl ability of the students in the group. The more pro¬ 
mising students are assigned problems of minor research, individ¬ 
ually or in groups, while the less capable students are assigned 
to perform standni'd laboratory experiments. For example, the 
following two arc some of the problems of minor research assigned 
to the more capable students:—the first of these is an experi- 
meiUnl study of the relative persuasiveness of types of adver¬ 
tising. Fifty types of advertising appeals were tried upon twelve 
hundred day and night school students. The second problem 
was Q study of the legibility of printing types as classified in 
groups with relation to their feeling tone. The less capable 
students were instructed to duplicate some of the well known ex¬ 
periments in the field of the psychology of advertising devised 
by sucli men as Scott, Gale, Hollingworth, and Strong. 

The .second j)urt of the course, required of all students, aims 
to .supply the need of an actual contact with the buying public, 
and also nLtemi)ts to bring before the students ijracticcti problems 
of advertising, In this, the applied part of the course, the students 
were concerned with the actual field problems in advertising. 
While it is, Hiricili/ speaking, impossible to separate the actual 
business purl of advertising from the application of psychological 
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Inciples to advertising', pracCicalli/ nt least, that can be done in 
measure. The reason for such on arbitrary division, into the 
isincaa and the psychological aspects of advertising, is that a 
urse in psychology cannot teach the student how to run the 
isiness ns a whole but only how to apply paychological prin- 
ples to certain aspects of it. 

Tho success of this applied port of the course depend.^ upon the 
lility of the instructor in charge, or the university ns hia agent, 
obtain the good will and cooperation of two important groups: 
'st, small scale advertisers; second, q group of repre.scntntive 
ofessional advertising men. The vicinity of tho university to 
large industrial city, while not absolutely essential, lends itself 
■lendidly to this purpose. 

Again in this ap])licd part of the course the class helps to 
'.termine the nature and function ot the ndvertiaing which is 
bmitted for its judgment by the small scale advertiser. In that 
ay the class has the opportunity to -verify its experiments and 
e validity of its claims for the application of p.sychologicnl 
.tegovics to the advertising of rnerchandise, just as much, as the 
iginoering student is able to verify hia surveying data matlicmati- 
lly. In order not to go far wrong in the deci-sions of tho class, 
id in this way waste time and money for its clients, the problems 
fore the cln-s-s and their decisions arc cliscu.ssed by the instructor 
om time to time with the above-mentioned advisory boiird com- 
ised of professional advertising men of high standing, chosen 
such a way tlmt they as a group represent the various types 
advertising agencies now in existence. 

It is important to understand that the stiulent.s in experimental 
Ivertising ore not expected to represent artistically their ideas 
the making of tho usual cut and copy, Tlmt is done for them 
id upon their bidding by professional artists and copy writers, 

, is not the functiem of this class, or any other in the field of 
sychology as applied to advertising, to tench the technique of 
irrying out ideas in the form of cut and copy. The function 
lUst always He with the schools of art and expression, and only 
ith those students who possess such q capacity. 

For the sake of clearness it may be expedient to state some of 
le field problems which made up the task for the cln.'is: 

First. A local storage and transfer company asked the class 
) consider its nclvortising problem, eapeciolly during the months 
f April and May, September and October, 

Second. A Chicago advertising agency requested the class to 
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suggest the method and the nature of the copy to be used in 
order to put before the public a new type of baby carriage. 

Third. A large manufacturer of paint asked the class, through, 
his Chicago odvertising agent, to prepare for hie use a pamphlet, 
of information about the nnttire and utility of his merchatidiae, to 
be distributed by nmil, coupon attached. 

Fourth. A manufacturer of gnrlcra requested the class to judge 
a secondary ulogan with reference to its effect upon the potential 
buyer, and if necessary to construct n new slogan more suitable 
for its purpo.so. 

This is by no mcniiH the only method that can be used to teach 
that sort of course, but it is a method, we believe, that has had 
a certain degree oC success. The primary purpose of this paper,, 
however, is to stimulate a vigorous discussion of the subject it, 
presents. 



[EASURING THE COMPREHENSION OF ADVER¬ 
TISEMENTS 


By A, T. POFFENDEJIGER 
Columbia Umversity 


One of the most fundamental rules of fi writer or n speaker is 
mt he shall "come down to'^ or not go "over the heads of his 
adience.” Tlie speaker may get un immediate roncLion from his 
adience that will tell him whether or not lie is obeying this rule, 
he writer, and especially the advertising copy writer, may not 
[ways be so fortunate, Ilis returns from any one piece or series 
f pieces of copy may be extremely slow and indirect, Where every 
ord costs many dollars, it is extremely important tliat each shall 
irry a message that will pay for itself and also bring a profit. 
0 be sure, pictures will do miicli to carry the message, and may 
t the same time hide tlie unintclligiblity of the copy. But even 
lotion pictures require some easily comprehended copy to make 
lem acceptable. 

Advertising, particularly national ndverti.sing, is mas.s .selling 
ad to be effective must appeal to the bulk of tlm public, It is not 
asy to Imow the ability of this vast public to comproliond the 
rintccl message. In fact, no one scein.s to have even gue.s.scd at 
10 level of inteHigcnce, so culled, of tlio wliite population of tlie 
biited States until the results of the Army intelligence tests were 
sported. The percentage of illiteracy Inii^ rocoivocl the most at- 
jntion, altho the much larger percentago of low degree of literacy 
1 quite as important, ^V(e need not here coiiccm ouv.selvcs witli 
le heated discussions as to whether '1110 average adult 1ms an 
itelligence of a thirteen, fourteen or sixteen yoar-olil person. Most 
f these discussions center around the question whether printed 
ymbols ai*G adequate material for measuring native intelligence, 
are here concemed with the capacity of the population to get 
he meaning of printed symbols, and with the degree to which 
le advertising copy-writer keeps within the limits set by the cap- 
city of the average person. 

Now the average adult can read, understand and deal with 
Tinted symbols about as well as the 14 year old child, or one 
vho has completed the elementally schools grades. It is to an 
udience of no higher type than this, about ono half of the coun- 
ry’s population, that the advertiser of generally used commodities 

<304) 
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must appeal. TluiL is, this degree of capacity sets the limit beyond 
which tlie cojiy-writer shnuld not go. ’ 

1, To wliat (logroe iloe.s the copywriter adjust his vocabulary to 
bis audience? 

Witli our little knowledge of the make-up of the advertiser's 
audience, comjdicntcd by Iho {shifting of maximum buying power 
from tlic professional cla.ssc.s to the laboring classes, it is not safe 
to cling to an unLc.sLed opinion on this matter. Moi-eover, it is 
a question which lends iLsolf readily to experimental measurement, 
It one wants to know whether bis copy is intelligible to his audi¬ 
ence lot itim try it on a rumpling of that audience, The follow¬ 
ing .studio,s arc intended to show whether or not such tests are 
necessary and at Llic same lime to show how they may be made. 

All Die H'ortl.v, excluding the names of articles, were gathered 
from 190 aclvertiscments appearing in one issue of the "Saturday 
Evening Po,st,'' "The Eadics' Home Journal” and the "Woman’s 
Home Companion." There were in nil 63*78 words and when all 
i-cpcUtion.s of various sorts wei-e eliminated, thci'e remained S7&G 
difforent worths. Tld.s list of words was checked against the words 
npjjearing in the "Teachers Word Book,” prepared by E. L. Thorn¬ 
dike. This i.s an aljihahcLical list of the 10,000 words occurring 
mo.«t commonly in a count of about 625,000 words from literatui-e 
for cliiUlron and forty other sources. Of our list collected from 
the tidverli.somcriLs, only 4 percent failed to appear in the “Teachers 
Word Hook.” 'I’lie copy-writer therefore, seems to keep fairly well 
within {/wHi! limits. 


Fiftneii of the woi’ds appearing in both lists were chosen at 
random and iJrescntcd to 37 persons, none of whom had gone 
throiigli High School, who were asked to give their meaning. The 
percent of crror.s for the diffei’cnt words including no answers 
and wrong an.swor.s, ranged all the way from 2,7 percent for the 
word "reputation" to 73 percent for the W 02 'd “zest." The average 
percent of error was 12 percent. Six words appearing in the ad¬ 
vertisement word list but not in the “Teachers Word Book" list 


were now tried on the same 37 people. The percent of errors 
ranged from 0 for “parasite” to 60 percent for "slusJr' Al¬ 
though 37 people of elementary school grade do not form an ad¬ 
equate sample of any one class of the population, these figures 
suggest that even such a word list as that in the Teachers or 
Book” would not be an adequate guide for the copy-writer to 
follow if he is to bu certain of understanding on the part of hia 
audience. The pciKcnt of error was just as great for wor s ap 
pearing in the li.st as for those which were not in the list. 

The following experiment with an actual advertisement showed 
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le effect of the poor adjuatment of an advertisement's vocabulary 
' its nudience.i An advertisement of the poster type for Premium 
am contained the following steitement: “An Epicure's Way of 
aking Ham.” The whole appeal lay in the meaning and connota- 
on of the word “epicure" and muat have been intended to produce 
favorable reaction in the lower half ns well as the upper half of 
le population. 

Another advertisement was prepared, duplicating this one in 
raxy respect except that the woi’d "Igorot” was sub.stituted for 
le word "epicure." These two advertisements were shown to 
ich of 63 housewives with the requests that they state which 
ay of baking ham seemed to thorn the more desirable. Twenty 
ine chose the “epicure” advertisement while 24 chose the “Igorot" 
Ivertisement, indicating that tlioy preferred to bake their ham 
le savage way. Since it appeared quite likely that some of the 
) who chose correctly may have been only guessing, they were 
sked to give their idea of an eqicurc. Seventeen of them .showed 
lat they liad sufficient knowledge to make a coiTect choice, 
hile the other 12 acknowledged that they knew tlie meaning of 
2 ither word and had no particular reason for their choice. They 
\d chosen one merely to comply with the invo.stigatoi’’s request, 
ixty eight peiceht of this sample gi'oup had failed to get the 
leaning which was intended. Although the illustration carried 
le atmosphere of a very pleasing food and made the advertise- 
lent a good one, another more readily understood 'word would 
irtainly have added much to its effectiveness, 

2 To what degree doe.s the copy-writer adjust hi.s ideas to his 
cdionce? 

It is quite evident that a person may understand every word 
I a sentence and yet not get the meaning conveyed by the sentence 

3 a whole, may not get the idea in the mind of the writer. To 
etermlne the degree to which the ideas presented in an advertise- 
lent arc grasped by the public a scries of tests was conducted, 
hese tests took the form of the Thorndike Reading Tests which 
re designed to measure the degree to which one understands what 
e reads. A passage is presented to be read along with a sei'ies 
f questions to be answered from the material read, In our tests 
n advertisement in its complete form together with a scries of 
uestions was used, or the copy of the advertisement was pre- 
inted in typewritten form together with a series of questions 
earing upon it. Nineteen seta of material representing different 
dvertiaeraeuta were testetl or\ more than 1,000 people. The ad- 
crti.sements ranged in character from the simple Subway Car 
ircl to the elaborate automobile advertisements. As it is impo.s- 
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sible lo inoscnL Lhc dula for all Ihe advertiaements in sufficiently 
brief sDuee, auiniitu.s will be chosen to illustrate the method and 
the nature of tlin I'csulls. 

Ojic Jnirulird n/id seven New York Subway passengers were 

nsketl lo road the udverUsing- car^ for the... Emulsion which 

contained the following copy: 

"Milk is tin (MnnI.ston. The .. Emulsion is emuisifiecl 

550 limes finin' Llipui milk and its ful content is eight times richer 
than the best milk. Th/tt is why physicians and druggists all over 
Amerieu, when asked Lo name the finest emulsion, answer The 

• - . Einvdaion. Ta.ste.s good—No Cod Liver Oil-Protects and 

Builds irealth." 

The following (lucatlons wens asked and the answers recorded 
by the inve.sligjitor.' 

1. W])al i.s an emulsion? 

2. Wluit cloe.s “emulsified 560 times finer thnn milk’' mean to 
you? 

3. Wlial is it Lliat makes nnilk an emulsion? 

4. Wliy does the . .. . Emulsion protect and build health? 

The answers Lo riucstiona 1 ond 3 demonstrated that none knew 
the cssentiid eliaraclerislicS of an emulsion, altho 46 percent 
knew tiuit un emulsion was fatty. To others it was merely a 
liquid and lo still others it was mei’ely white, Answers to ques¬ 
tion two Klujwe^l that none grOaSped the significance of the state¬ 
ment. About 30 poi'cenl did say that it meant that the ..-. 

Emulsion is 550 Limes better than milk. Although this belief is 
misleading it is not damaging to the product. Sixty-four percent 
believed that this emulsion, would protect and build health, be¬ 
cause "it i.s better than milk” (24 percent) or because "it is recom¬ 
mended by physicians and druggists” (40 percent). Although this 
advcrti.scment may be considered effective, there is a great question 
whether tlie copy-wi'iter really "put his ideas over,” and obtained 
the maximum effect possible. 

Forty seven woincn, all of whom looked like housewives, were 
asked Lo read the following car card, which is of the simple pub¬ 
licity sort: 

. Golden Syrup. Made from Cane Sugar. For Table- 

For Cooking.” 

The qucsLion.s asked were; 

1. Why should you buy a can of- Syrup? 

2. Why docs cane sugar make goad syrup? 

3. WluiL otlior kind of sugar could bk; used to make synip? 
To question one, eighty percent said they would buy it because it 
was miuJe from cane sugar. This was, of course, the only selling 
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gunient prcseiitotl in the ndverlisement. But in answer to the 
cond question it \vas discovered that no one know w/iy cane sugar 
jiild malro good syrup. The answei's to question 3 sJiowed that 
I jicrcent knew of no other land of sugar from which syrup 
ight be mfide. Further cjueatsoninR of those who said they would 
ly this product showed that it was tlio prestige of Lhc trade 
ime that was effective, and that the only actual I'ciison given for 
lying tliis product l^ad not done its worlc. . 

Following is the copy taken from an automobile advertisoTnent 
id presented to 55 college men with the request that they road 
and answer one question about it. 

“HumaniLy may be u million year.s old In point of time, but 
is as young as this morning's snii in its pursuit of the ideal, 
fter two Ibousnnd years of disappointment and disilUunon, the 
ernnl verities and the eternal values still prevail . Even 

lOUgh it he surrounded and seemingly obscured hy sluun un'l 
'otense, nothing in thj.s world is (liscovered so .surely as solid 

srit. Tins i.s the truth that embodies all truth; this is 

lU irutk ihsi makes men free.” 

Thirty percent of the group could not answer the ciucKtinn wliicli 
ns; M^hkit is the truth that embodies nil truth? A.s Lhoy flicl 
)t discover that “nothing in this world is discovered so surely 
I solid merit,” they could .‘'co no coiinoclion helweiui thus para- 
■aph and an automoUilo ndvcrli.scment. Oiio par.son who hud 
id cxpovieiicc in copy-writing agreed that “it miglit he part of 
poor advertisement for a good automobile.” It seemed useless 
> try this paragraph on lo.s.s intelligent groups of i)eopJo, who 
, the same time might reprc-sent bettor automobile jirospects 
lan Lhc group used in our cxpcrinicnt. 

This paragraph was difficult or impossible to understand be- 
lusc of its abstract ideas and the complicated character of its 
instruction. Another case studied, that of a doube-page adver- 
sement for a new safety razor owed its difficulty to the wealth 
; technical details involving n greater knowledge of physics than 
i possessed by the majority of people, even of college student.s 
ha have had the advantage of a caai'na in physics. The actual 
dvertisemeut was used in this experiment and its content is 
10 long to reproduce in this connection. It is described in some 
3tail in another article by the author*. All that need be mentioned 
ere is that of the 55 college students who were uskccl to answer a 
jries of 7 questions about this axlvcrtiscmcnt, with the privilege 
f consulting it as often as desired, practically none was able to 

’A. T, PoIIeiibcrgsr, .Ic»urr>nl of Applied PHychoJoRy. 1023, 
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l>insp the techiiicEil details on which the success of the product 
depended. 

The study of the nineteen enses, of which those given are 
samples, shows tiiat advertising copy both in the vocabulary used 
and in the nature of the ideas presented frequently "goes over 
the heads of its audience." The trouble is frequently hidden in 
one or otl\cr of two waya or both. First, the excellence of the 
illustration may overcome the shortcomings of the copy or make 
the tidverti.scment successful in spite of thd copy. That copy can 
convey the most ubstruse ideas so that they shall be easily under¬ 
stood, the reading of the masterpieces of literature will show. Sec- 
ond, people may be convinced of the value of an article even when 
they do not understand what is said about it. But since we do 
not know the extent to which this sort of reaction prevails in 
human behavior it docs not seem safe to rely on' it for successful 
advertising. It is a matter, however, which the student of Ap¬ 
plied Psychology might well investigate, 

The unfailing remedy for suspected unintelligible copy or copy 
that i.g difficult to understand is, as suggested in the beginning of 
this paper, a very simple one. It is, “Try it on the audience,’' 
Take a ^mnpling of that portion of the public to whon) the copy 
is lo appeal and by a scries of questions, carefully prepared be¬ 
forehand, find out ju.sfc what is the reaction to the copy. The 
Applie.d Psychologisft who is interested in measuring and predicting 
liurnan holiuvior in eases of this sort I’olios upon no general prin¬ 
ciples Lo guide him, but resorts lo the method of sampling just as 
the cliciiiical ongiiieer or the physical engineer tests his materials 
by Ihc metliotl of sampling. And just as in these latter cases, 
skill is required in obtaining the samples, in measuring them, and 
ill drawing conclusions from the measurements. 

The advice of Robert Louis Stevenson to “Write so that the 
fool can UTKlorstnncl you, and the wise man will understand you 
also," ia, indeed, good, provided that one takes pains to discover 
•wlmt the fool can understand. 
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The increased appropriation voted by the Eighty-fifth General 
saembly of Ohio to the Bureau of Special Education and Psycho- 
iucntion.'il Clinic of Miami University, has enablecl Lho Bureau 
increase its staff, to enlarge its facilities for training teachers 
d supervisors for special classes for subnormals, delinquents and 
cech defectives, and psychological examiners, and to open a 
anch station in Cleveland. In addition to the director, J. E. W. 
allin, the staff includes the following: in the Dayton center, Mrs. 
ssie Wilson, M. A., University of Michigan, and Mias Janet 
jlcomb, M. A,, Columbia University; Psychological examiners 
d instructor.'], Miss Mildred Grimes, B, A,, Western Reserve and 
aduate student at Columbia, instructor in industrial arts, critic 
Eieher and Miss Eva Nutting, student in the Bureau of Special 
iucation, Miami University, critic teacher; and in the Cleveland 
anch, Bertha M. L\ickey, Ph. D., University of Nebraska, and 
•eva Witherstay, critic teacher. 

Students are admitted from all sections of the country without 
her charges than a nominal registration fee. 

.SPRCIhl, KDT’CATION, OlIJO UNIVIOURITY, ATIIMNH, nillO 
The work in Special Education was establi.shed in the College 
Education of Ohio University, Athens, Ohio, in 1920 in con- 
iction with the Department of Psychology and Paidology. In the 
11 of 1922 this work in Special Education was made a separate 
irt of the Training School in order to take care of the Special 
asses in the City Schools of Athens ns well a.5 to meet the calls 
ming from the students desiring practice in schools for excep- 
)nal children. Miss M. La Vinia Warner, graduate of Columbia 
niversity, New York City, is directing the new department. 
Special facilities were already afforded by Ohio University 
r the preparation of teachers for this line of work because of 
,e opportunity for the selection of subjects offered by the 
3llcge of Education and also the College of Liberal Arts to 
hich are now added the Special subjects further needed and the 
pecial School for exceptional children as a training school. The 
jed for special education in the public schools of Athena and 
tbens County affords a wonderful opportunity for the study of 
1 types of exceptional children and the social conditions give 
udents n good opportunity for the study of and practical ex- 
jrience in Social Work. 

A group of fourteen students registered for the work in Special 
ducation in the 1922-23 term and thirty-seven students came in 
ir the Summer Session of 1923, The demand for the work is 
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growiiifi: ra|ii<ily tlirouffliout the State of Ohio aad more calls 
than can he filled nre coining in for teachers trained in this field, 

W. V. has ^w'n eloclcd Editor and L, L. Thnrafcone 

AsKocintu I'lfliLcn* of the Journsil of Personnel Rcssearch, C. S. 
Yoakum conLiiuu's ns Mnnaffinff Editor of the Journal which is 
now ontfi'injr oji its si-cojid volume. Tlic other members of the 
editorial board are ‘Wesley O. Mitchell, Alice Hamilton, Prank- 
wood E, Williams, II. W. Hn.shand, Mntthew IVoll, Leonard Outh- 
wflite, J(i.s<ii)h IC. WilJfits, I,ewi.s M. Terman, Alfred D. Plinn and 
Mary 'Vnti Klecik. 

This Journal is devoted to the scientific study of personnel. 
It publishes original researches in the applied sciences that con- 
triinite to ovw knowledge and oitx* cITective direction of people at 
work. It is tlui ofllcial organ of the Personnel Research Federation 
whoso purpose is the furtUernnee of research activities pertaining 
to personnel in industry! commerce, education ami government 
wherewer such vcscurches arc conducted in the spirit and with the 
methods o£ .science. It brings together workers in the biological 
find medical .sciences, psychologists, psychiatrists, engineers and 
economists wlio are making significant contributions to more exact 
knowledge oC human beings at work and methods of making effect¬ 
ive and satisfying ndjustmcnla between men and their work. 



BRITISH ASSOCIATION FOR THE ADVANCEMENT 
OF SCIENCE 


Toronto Meeting, August 6th to 13tii, 1924. 


SliCTlON J (F9YCIIOC.OGV) 

Dear Sir (or Madam), 

A meeLiiig- of the British Association for the Advancement of 
Science 'will be held at Toronto, from Augu.sL 6Lh to 13Lh, 1924. 

The association has recently added to its various SccLion.s a 
Section of Psychology. The Orgaiii.sing Committoc of the Psy¬ 
chological Section belicYes that the meeting will alToi'd an imiciue 
opportunity for intercourse between psychologists of Canada, the 
United Stales, and Great Britain; and accordingly issuc.s an invi¬ 
tation to any psychologist in the United SUitcs or Canucla, who 
inay desire to do so, to join the Association as a member for the 
Meeting, and to contribute a paper or attend the discussions. 

Professor McDougall, F.R.S., of Harvard University, has ac¬ 
cepted appointment as President of the Section; nnd it is hoped 
that he will deliver the presidential address.. Other papers have 
been promised by Dr. Morton Pxdnce, Dr. Brett, Dr. Bott, Dr. 
Bridges, Dr. Santlford, Dr. Tait, by Dr. Myers, Dr. Burt, Dr. 
Drever, Mr. Fliigel, Dr. Miles, Professor Pear, and other leading 
American and British psychologists. 

Joint Meetings have been arranged with the. following Sections:— 

Section H (Anthropology) to discuss "Racial Mental DilTer- 
ences." 

Section I (Physiology) to discuss "Application of Physiology nnd 
Psychology to Industiial Efficiency." 

Section L (Education) to discuss "Tests for Scholar.shipa and 
Promotion.'' 

Papers should not require move than. 20-30 minutes to rend; 
anti intending contributors should send n notice of their papers 
before the end of March to the Recorder of the Psychological 
Section (British Association), The Psychological Laboratory, The 
University, Leeds, England. Further particulars as to membei'- 
ship for the meeting can be had from the Secretary, Briliiih Asfjoc- 
iation, Burlington House, Piccadilly, London, W.!., Englfiiid; and 
notices of the general aiTangement will be issued in due cour.se by 
him and by the Hon. Local Secretary in Toj'outo. 

We are, 

Yours faitlrfully, 

LL. WYNN JONES, Recorder, 

CYRIL BURT, President (1923) 

W, McDOUGALL, President (1924). 
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Amikjit S. OsjtoUNK, Thf' Pyobft M of P.-oof, pp. xxii + 52fl. 

MnLlliov Di'iiflir Sz !*»., New V^i’k ami Albany, 

.StdflfnU fif b.'K.-jl i»ay«?lu»lfif^y sliniibl luive access to tliis volurao 
by Ui(.‘ (iiatiriKUiiilK'fl imllior of “Qiu'stlomjd J^ocuments." Mr. 
Osljyni lias lifjt'ti :i close student of liuniuii uatui-e, especially ns he 
has ol>s<'rvc(l it in trial la^Yy^•^■.s, jikIki'S, jurors, witness, liliffants, 
niul ci'iininuls, [[♦• uiulerstiinila iierceptiou niul miMuory, reason¬ 
ing' ninl emotion, s»ij%p‘sliou anil persuasion, creilulity niul deceit; 
and he has liei(‘ puL down ihc rich areumululions o[ his wisdom 
fur Ihi: piiidaiu'e of iriul jillorneys and the furtherance of juBLice. 

Of Lhr Lwenly-mj'hl. chii|»Ler.s, tlie psyeholofyiKL will especinlly 
enjoy SifLinj'; the Kviilcime, The Atmosphere of a trial, 

Orijs'i-lC.yiiiniimlioii, Mi-inory niul the I’l'onf of Fncts, Advocacy, 
Persiiijsion nntl J’rjielieal P.syeholoify in Courts of Lau', Form 
I))iiidne>,s, Till' Do irmiiiif ninl of ComT lloonis, and Th9 

Judr,v' in })i.K|»(Hod Doeument Trials. The vocational counsellor 
and Liu- iiro.'j|)f<'livi‘ nltoriK’y shoiihJ re/ul, beginning: on pnge 23'1, 
Ur. O.s'lioi'n’s dcKoriiitlou <jf llio l•eflUll■om<•^ls of the great lawyer. 
Carnegie Institute «if Technology. W. V. IJingham 

Illif.CN T. \Vi)(u.t,t;Y ami lOi.tZAittn'ii Parris, Dhiffuasis and Treat- 
ment t\f Yunwn St-.kmi /'’rtiYwrcs, Bulletin l{l23, No. I, p. 1X5, 10 
coiits. Department (»C fntei'ior, Buronii of Education, Washing¬ 
ton, D. C. 

liolh the toaclier and the psychologist will appreciate this 
pict\u‘c <if wlml may he nccoinplishod with young school failures. 
Vni'iuUs menial umt cclucitUonal tests were Used in selecting the 
sixteen children for the "domonstrntion class.” Tho childron in 
the cUi.sK varied in cUrono)oi;ical age from six years and seven 
numlhs to ten years and four months, and the intelligence quo- 
LionLs oP tlio first test vtti-ic<l from seventy-five to ninety-five. 

TJk! rhildi’L’ii were grouped for .study into four dominant causes 
of Lhtdr dinicultic'N, «.s neglected children; high-grade defectives; 
.specinl dcfi’ol.s in .sonic one .subject; and psycliopathic children. 
I'lacli type l.s reported in the bulletin separately and each 
ca.so j.s very completely reported, giving many helpful points in 
ini<lcr.stftii(itng such children. 

Tilt! entire arllclp is a pJen for proper treatment and classi¬ 
fication of (‘xceptioiial children. One of the besfc^ arguments for 
.Siii'cial Educntiim that i.s shown in the huUctin jo found in the 
discussion of tlio changed attitude of the children towards school 
and life. This is cei'tainly worthy of consideration. Anotlier is 
that the intcIJIgence quotients of those children increased with 
the .suptn’ioi' teaching. 

Ohio Univoxsily. M. La Vinia Warner 


Bfrnaui) C. Eweu, Applied Pschologi/ pp. xii+<180. Mocjnillan 
Co„ N. Y. 1923, 

P.sycliology must be saved from her friends.^ LiUe many another 
well-favored jnde of popular acclaim, she is in danger of Ixaving 
hex' name hccoino a by-word and a term of reproach to be thrown 
ill Llie tecLJi of her too much pi'eoccupiod guardians, the of 
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Psychologists properly speaking. Wliile they are engaged in 
cautious, painstaking effort to extend their own knowledge con¬ 
cerning her mysteries, interlopers and charlatans of all sorts are 
greedily capitalizing- the credulity of an uniformed public, to the 
■ultimate harm of both the public and the lady in question. 

To sho-w that she's not at all that kind of a gal is the raison 
■d’Hre of the volume here under review. To give the author’s own 
statement, "There i.s a lack of literature which attempts to present 
in a readable foiun the principles, methods, and results of scientiiic 
psychology as applied to problems of everyday life." 

For those at all informed the author’s thesis needs no more than 
its statement to be accepted. Book shop.s, magazine stands, pop- 
■ular lectures by "mentalists," all are more or less shamelessly 
vending under the name of Psychology various nostrums concocted 
at best under the animus of ignorant and misguided enthusiasm, 
at worst with cynical disregard for intellectual decency and with 
unscrupulous motives of gain. The method and tecliiquea of 
science are caviar to the general, who ns a rule prefer food of a 
diiTeront sort, Any effort such as the volume by Professor Ewer 
to cultivate a move discerning taste is wholly commendahlo. How¬ 
ever much psychologists may differ ns to details of method and 
interpretation—and that honest differences of opinion do exist 
no one will deny—there can be no disagreement on the general 
point of view espoused in this book, the point of view of any 
scientific discipline. 

The book is divided into four parts. Part I gives a treatment 
of Aims, Principles, and Methods. After a brief survey of pro¬ 
cedures and techniques as related to the aims of psychology a 
clarification of the concepts "subconscious," "unconscious,” and 
"suggestion” arc attempted. Part II deals iviLh Education and 
Everyday Life—a sketch of what is ordinarily thought of as 
coming within the purview of educational psychology. Under 
Mind and Health, the general heading for Part III, the aullior 
treats those things which are probably mo.st frequently as¬ 
sociated with the term "psychology” for the layman—psychonaly- 
sis, psychotherapy in general, faith healing, etc. Part IV con¬ 
cerns itself with a survey of the methods and problems of psy¬ 
chology as applied to industry and commerce. 

Probably any such popular introduction as this must be un- 
.satisfactovy from the standpoint of the special student. Thi.s 
would doubtless be true of science.s much better organized than 
psychology, A wise friend of the reviewer once defined all 
teaching as being a process of judiciou.s lying. All of us who are 
engaged in the art necessarily have our individual notions as to 
wnac should be emphasized and what omitted. Since the book 
makes no pretense of being a compendium of all knowledge psy¬ 
chological, however, no strictures can properly be applied where 
the matter is still one of opinion among those qualified to judge, 
but only when questions of fact arise. 

One rather serious lapse in this connection is the .statement 
that Lho coefficient of correlation "in common use known as 

Gsunid" 

'Pearson's coefficient of correlation is-,” This formula 

IS not in common use for serious correlation studies nor is it Pear¬ 
son's formula. 
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A fc‘\v oUuT iminlR nn whii-h psyrholn^iKlM Jiifffht lioncstly diJTer 
mfiy he ln/o/]y ninUiniivrl. (1/ The hf.si<n'y of the two terms 
"uncoJiKciod!;" ainl “idilM'niiseimis" lm» luit hcon such b 3 to throw 
nil llu- oliloiiuy (if vopri-soiiiinir a niythicat potency rnthor than a 
scioiiliJjr cinin jil upon Ihi* fonnor, ji.s Ijii* author l,s inclined to do, 
Tlic (ii'jciH'O'iiL lu-i«- niif tif Mciiiiisluphelus' udvisii to the 

sLuiIi'iit in (i> hallli' only with wonf.s. 

"TM'iin I'ln'n Wo Ih'^.^rilTt* fi-hlon 
3>-'i .■•Iclll fin Wori zur rorlilen Z«il sich ein," 

(2) wovltK mrrJminriifij/, It nets with a tc- 

^'uliirity of ('iiiisr and olTni't which in diatincL from rational self- 
direcliuii and iiihihillnn." (iiicry, aside frani the question of faet: 
is a Kffi i/ff dl' ii ychnlony iio.sHitiUi tni any oUicr basis than inech- 
anislic pnstulaloaV (III To Ktihsuinc under the gonevnl heading 
of "sfU'i'iii] ijil«')ligenri« H-.st.s" .sui-h n diversity of tests as as- 
sot'iat<'s (csts and s|n'('ial nriiieyeniciit tests of all sorts (educa¬ 
tional tests) lends only fuvllu'i* to hefog nn already very cloudy 
issue—especially for Lhi* hiy im.tsoji. (4) Tlie attempted clia- 
tinctioii ln‘i\ve('n individiinl'and "Koeinr' suggestion might be 
qucstioiK'd, (f*) ''IVhat is needed [in regard to religious psy- 

ch()lln‘raj)y] is..a nuii'e studied jiractice of superposing religious 

failh npoji jncdicHl efim-." (0) Tlu;re is a woji tfcr/ailn?' in the nr- 
gutiienl for the liiTedilary meiiliil similarity of siblings (r of ,40 
to .7a, which ineaiia 10 to .'10 per cent hotter tlian a sheer guessj 
juu'Licularly wlien the author lulviinccs this argument; “Espeo 
uilly in Lu’in.s j.s the mental similarity cunspictmus, and since it 
is iHit siilisilaiitinily greater in older than in younger twins it 
cunniil he ascrilted to education.'’ The redative weight of heredity 
7’«. envij'onnirjiit i.v not ilomnnslrated in .such figures, or by such ar- 
gmuMit. ( 7 ) III view of the fact that “Freudian psychology" is 
deprecated an gei»‘rmisly--'an(l .some of the psychoanalytic lit- 
CMMiUire cerlainly warranLs this—it would seem to have been only 
fair In have dlil'erenllated in«re carefidy between the j^ronouiice- 
nu'tils Ilf Fi’i'ud aiul those of somti of his ovcr-cntlmsiastic fol¬ 
lowers. “Tlte recummeudatioii of its [Freudian doctrine] extreme 
Hdvricale.s Dial (/ne should refrain altogether from interfering with 
the (THotinii.s" i.K certaiiily cuiintoi' to what Fj‘(?ud explicitly states 
in liis ({(uiei'iil InirodiicLion to Psychoanalysis—which the author 
lists ill his Itihliogrnphy. 

AV’iLlt nil llie.Ht! Mtriclure.s llic pre.sont writer fools that, the book 
has a Icgitiimde idacc. Thu intelligent layman and the beginning 
sLudeiiL stiiiuld I'liid it of value. Part IV on Industry and Coni- 
nu'i'L'c; i.s pai'Licnlarly well done, and the chapter on Social and 
Moral J'’act(ir.s ftux's .sonic of the larger problems involved in 
hunum iuljustmonts. 

Purduo Uiiiv'or.sity Hermann REWMEns 

Dunam) a, Laiiu), Ph. D. Applied Psychology fov Nur&es pp. 
xi-)-2H(j. J. H. Lippincott Co., Philadelphia, 1923. 

In tlii.s little voltiine the author has "seJect(3d friim the vast 
liLevaluve of iisychology those facts of most immediate nio to 
nurses in uiidcrsttimling the patient, themselves, and their 
mun," n.s nnnounced on the paper covoi*. I should say that he 
ha.H floiic more tliiiii that; he has gone further into the pieservea 
of biology Limn many psychologists would venture—a procedure 
cjuiLc conunt'iuinblo, 1 believe. , , , , r j 

Written in popular, newspaper English, the book should commend 
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itself to those witli the amount of pi'eliininni-y tvainiiiff that the 
ordinary nurse has, as well ns beginning students ol psychology 
generally. The advanced student may be n bit irritated or even 
slightly scandalized at the irrevcrance manifested toward the 
household gods of psychology in some of the chapter and section 
headings—e.g., "Enter the Villain”; "A Practical Joke on a Sen- 
Anomone"; "The Moon and the Devil Blamed.” 

As already intimated the book is biological and behavioviatic 
ill viewpoint, It is divided into four parts. Part I aUuinpts to 
orient tlie student with respect to the origin, scope, and applications 
of psychology, witli particular reference to medicine and nursing; 
this is (lone in twenty-five pages. In Port IT, the most technical 
part of the boolc, the author treats the biological aspects and 
foundations of Ijohavior. Part 111, entit'ed '‘Apiilications,” is the 
piece (le resistance i learning eiiMcronology, temiicvanients, in¬ 
stincts, psychoanalysis, suggestion,—these, although not all called 
by their first names, indicate the rubrics under which the dis¬ 
cussion may be classified. Part IV is given over to somewhat more 
general, sociological applications of psychology and psychiatry, 
with partieular regard to the subject of mental hygiene. 

The author stares in the pi'eface that he has "ondeiivorcd to 
avoid all controversial matter not borne out by fact," and has 
succeeded in the main. The chapter on The Teniporaments in 
Nursing, however, offers opportunity for polemic to one contro¬ 
versially inclined. The nncient classification of the temperaments 
could well be improved from the modern point of view of abnor¬ 
mal psychology. To trace the inheritance of these various traits 
as unit characters (p. 126) seems to me more than cjuestionablo, 
the study of tlie Eugenics Record Office, which the author quotes, 
notwithstanding. Any mention of the glands of internal secretion 
upon behavior also opens up another debatable question. It is 
only fair to say, however, that the author treads rather lightly 
here, 

These strictures are, after all, only minor and largely theor¬ 
etical matters, There is sufficient warrant and need for n book 
of this sort to make it a valuable adjunct in the training of 
nurses. The portions of the book dealing with mental hygiene 
and the applications in general are well worthy the attention of 
the lay reader and beginning students generally. Unconvention¬ 
ally written as the book is, I am not prepared to state that this 
is a fault rather than a virtue. 

Purdue University Hermann Remmf.rs 

Mead, Arthur Raymond, Leaming and Teaching. Lippencolt 
Company, 1923, pp. XI and 277. 

Learning and Teaching, as the title sugge.sts, is a study in 
applied psychology. The author has endeavored to cause the 
student of education to apply the general law.s of psychology to 
a great variety of class-room problem.s. He has consciously at¬ 
tempted to do something that will aid in removing the source 
of much criticism against present-day teaching of psycliology 
and education, in our modem teacher-training iiisUtuLions. There 
is the persistent criticism, often very bitter, that instruction in 
psychology and education fails to carry over from the teacher- 
training institution to the actual teaching of boys and girls. It 
is this criticism that has prompted Professor Mead to offer the 
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tcnchci-.H of tins cinuiLry n jiow hook oj) t)io subject. 

Pr(ifc8Mir Mead Ikih devoted one half of his 277 pa^es to. 
oxereiKiH and icii'ii'nccs. '1 Iu>hp exeicisos and icfovoiKEs cover u 
wide raiu'o <if lopio!;. Anions Iho Iniiics cnnsiderfcl are the follow- 
iiifr; Thr luUure of hiitnan (eaniiiijr, the I'cncral and individual 
fac'cii-.? that iiifliiortce h-annior, IItc iniiisfcr of learning, the meas¬ 
urement of menial fiincDoim, p.syohoto^riral cfnid’tion.s concerned 
wUlt ihn (‘lejiienl;ir.v and aecotidary (nn'ric\i)a, and lln? p.s^’chological 
condition invfdvrd in educational mothods. These topics receive 
a minimum of disnii.sinii. in fact ihe discusnion of the text frs- 
(|ucnlly is too liiniled to nK’u ti>c stiuient adnciuntc knowledge of 
Ihf! lU'mciido under (:(iii!>idc!iatioii. .Smh infoi'inafon, however, may 
bo readily rrallim-cd by the .stndenl fiami the excellent list'-, of 
lofcvi'iii-eK appeiiihni to I'lnh topic. Thin approach to the subject 
is fumiliitr to ihosi'* uctpiainlrd with the Ihiiici/.ios of Toachini?' by 
ProfesKoi' 'J'horndilu?.. ‘The inrvLls unci limitations of such an ap- 
pvoiich iiro apiiaviMit, 

Professor Aioad has done .students of education a real service- 
by collficliji/f thiH oxlendod Il.st of varied exercise.'! and by care- 
fiilly scloctijiif reference.^ benrin^r on each topic, The exercises 
.show disci'imhmtion in tlmir selection and arraiigemant, and with 
the propor use of the sugecKted references, should give satis¬ 
factory rcHultH. 


Loosmouk, W. ClIAiU.KH. Tlic Gahi, oJ Pcritonaliij/. E. P. Dutton- 
& Co, i)p, 233, Price lidj.bO. 

The Gain of Personality is a popular psychological statement 
of tlie practical values of ircrBonality, In the course of his dis¬ 
cussion, the author has treated the nature, elements, and general 
clovclopincnt of perHonaJity. Kacli of the tlirea major divisions 
is analyzed Into its component parts. Under the g-eneral head' 
of element of per.KOjmlity we find such sub-divisions as indiyid- 
unlity, .sincerity, courage, enthu.slasm, sensibility, self-expression,, 
humor, and venoao. 

The book offcr.s clear evidence that the author is acquainted 
with booic.s and men. lie states hi.s position clearly and with 
effecUveiie.s-.H, Throughout he direct,g the reader’s attention to 
tho.se elonient.s in tlm life of the individual necessary for suc- 
PGKs. He ])ointft out wherein many people fail, and indicates 
the eloincnt.s ncce.ssnry to success. 

In brief tlie mission of the book is not to discuss personality 
"tlieoroticnlly or philosophically" but "practically and help¬ 
fully." A reading of tlio book should aid the individual in 
taking .stock of Jii.s personal merits and limitations. 


Wki.ls, Geoiigk Ross. Konf/i and t/ia Ojjen Door. E. P. Dutton, 
1.722, pp. 17f5. Price ,?2.00. 

The book contain.^ a .series of lecture.s originally delivered to 
fro.sljmen in college. Tlie purpo.se of the author is to present 
to young' students certain Jaws of mental life whereby they 
may reali/.e the liivgc.st benefits possible from then’ four years 
in college. With this point in mind, tlie author has chscu.^eci 
instinct, habit, vememheriiig, attention, intei'e.st, tbmking, emo¬ 
tions, causo.s of failure, choice of vocation^ and character aw 
temi)o)'ameijt. The di.scu.s.sion of these topics is non-techmcai 
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in character, and is desigiied to make effective certain laws 
of psychology. The author’s psychology is modern and its 
application to the task in hand is clear and judicious, 

The reader turns away from the book with the feeling that 
the effort of the author has been worthwhile. Ho has pointed 
out certain aids in the use of the mental powcr.s that can not 
fail to benefit the student. It is certainly tlie type of book 
that should find its way into the hands of our youth wlio 
desire to make cconoinc use of student days. 

On the whole the book is well written and place.n its message 
before the reader in an effective mannci’. 

In brief it is an effort to apply lessons of p.sychology to tlic 
very processes which make imssible p.sychology. 

Hoke, Roy Edward. The Improvemanl of Spevil and Acciiraeii in 
Tiipewi'itinff. The .Tohns Hopkins University Studies in Edu¬ 
cation, 1922. pp. 42. Place 7hc. 

Experimental .studies in learning typewriting are not num¬ 
erous. Book’s well-known study concerned it.self chiefly with 
the psychology of skill. He did not stre.ss the improvement of 
speed, accuracy, or methods of leaching typewriting. 

In his study. Dr. Hoke has selected five dcfiiiitG ftuc.stion.s 
for investigation: First, an investigation of the frcfivieiicy of the 
occuri'cnce of letters and marks use»l in the RiigliKli language; 
Second, an examination of the number ami distribution of evror.s 
made in actual typewriting, and in so far as possible determine 
the causes of the errors; Third, a study of the relative ahilitie.s 
of the eight fingers and of the two hands; Fourth, the determi¬ 
nation of the loads or burdens of work placed by the prc.scnl 
system upon tlie fingers and bauds; Fifth, an atlcmi)t to |)t)int 
out the consideration which must be admitted in an effort to 
arrange a keyboard on scientific pi'inciplcs, 

The study clo.scs with a suggested koylnaard together with 
certain criticism of the proposed changes in the Iceyboard. Tlioro 
is appended a bibliography of twenty-six title.s. An would be 
expected most of the titles discu-sa the more general problem of 
the acciuisition of skill. 

To the reviewer the study deserves careful considoraiinn by 
those interested in teaching typewriting and wlio are anxiou.s 
to produce a product with the highest .sldll and accuracy. It at 
Jea.st sugge.sl.s a method of approach of inve.stigating way.s .ond 
mean.s of improving skill in one of the mo.sL widely used sldll.s 
•of man. 

Hoke. Elmeii Rhodes. The HleasHrcnient nj Achicvomiiti in 
y^horthand. The Johns Hopkins University Studic.s in Educa¬ 
tion, 1922. pp, 118. Price $1.50. 

In this monograph Professor Hoke gives an account of four 
scale.'^ that lie ha.s consLiucted For use in connection with teach¬ 
ing Gregg Shorthand. The author recogni’/.es the fact that ilu* 
use of shortliajul in a complex pi’oces.s, involving inontal and 
motor factors. In hi-s analy.sis of the proccs-s, the author .sclectM 
four important aspects for consideration. These important a.spccts 
are reading ability, quality of writing, speed of writing, and 
knowledge of the .system. A sci)aratc scale has been constructed 
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for each o£ tk TcntaTivo'mms fo? each 

u si?^oh";at ^ 

v/lth in 'setter inetliods of teaching 

or tcacIioi'H of .'horlh 1 \ y ,. ^ of shorthand. 

[11,(1 consfi^iiK^ntly hoLU.i «|U‘Ui M^iLUS L. Gard 

Ohio Univci-.^^iiy 



NEW BOOKS ANB PAMPHLETS RECEIVED* 

Boolcg and pamphlets for review ahoultl bo sent to James P. 
Portov, Department of Psychology, Ohio University, Athens, Ohio. 
Baudouin, L, Chaulbs. (tvanslntcd by Fred Rothwoll.) The Birth 
of Psyche. E, P. Dutton & Company, New York City. 211 pp. 
BvnNE, Lee, Latin Tests in loiva Hiph Schools. University of 
Iowa, Iowa City, Iowa. 40 pp, 

Dickson, Virgil B. Mental Teata and the Classroom Teucher. 

World Book Company, Yonkera-on-Hudson, N. Y. 231 jip. 
Ewbb, BenNARD C, Applied Psychology, Macmillan Company, 
New York, 480 pp, 

Forbes. Joseph, Lehrbuck der Expcrime?itellcn P^si/cholo{/io. 
Herder & Co, G, m- b. H. VQrlagsbuclihamllung, Freiburg 
ira Breisgau. G31 pp. 

Gates, Arthur I. Psychology for Shtdcnls of Education. The 
Macmillan Company, Now York. 48S pp. 

Haldert, L. a. Whitt is Professional Social Workl The Survey. 

112 East loth St., New York City. 149 pp. 

Hall, G. Stanley. Life and Confeasiona of a Psycholoyisl. D. 

Appleton Company, New York. Friee 55.O0. 023 pp. 
Henderson, C. A. Personal and Businens Efficinicy. George H. 

Doran Company, New York. Price $2.00. 308 pp. 

Monsarhat, K. W. Health and Ihr Httman Spiyil. B, P. Dutton 
& Company, New York. Price §2.00. 132 pp. 

PUnLTCATTONS lS.'<rKl) IIY TUB llBJ’AlITMBNT (IF IXTKUloU, 

in'PKAC 01? Bm-cATin.x. wasuixuton, d, c. 

Amcricanizatiol hi the United Slates. John J. Mahoney. Bulletin 
No. 31, 1923. 42 pp. 

Analytic Survey of State Conmes of Studff for liural E/omentarjf 
Schools. Charles M, Reinochl. Bulletin No. 42, 1022, UG pp. 
An Americanization Program. E. J. Irwin. UnlleLin No. 30, 1923. 

60 pp. 

Art Ediicaiioua‘. The Pi'eaent Silnation. Royiil Bailey Fiirnum, 
Bulletin No. 13, 1923, 20 pp. 

Athletic Badge Tests for Boys and Girls. Physical Education 
Series No. 2, 1923. Prepared by the Playground and Recrea¬ 
tion Association of America. 17 pp. 

Bible in the Public Schoola, Willinm R. Hood. Biillcitin No, 16. 
1923. 13 pp. 

Child Health School. Conducted nt the University of Chicago, 
1920. Lydia J. Roberts. School Health Studies. No. 2, 1923. 

60 pp. 

College Entrance Credits in Commercial Sitbjects. Glen Levin 
Swiggetfc. Cominei-cial Education Leaflet No. 4, Anril 1923, 

22 pp. * I . 

•Mention Uore ducH not nrecliidc fiirllicr Gomn;t>nt. 
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^Como^i<lation of Sc/tools in Randolph Coimty, Indiana. 0. H. 

GreisL. lUivul School Leaflet No. 12, 1923. 11 pp. 
ConaolHlation of Schools of Weld Coimty, Colorado. C, G. Sargent. 
Buvnl School I-enflet No. 13, 1923. 11 pp. 

Extension. Charles G. Maphis. Bulletin No, 24,1923 

32 pp. 

E(li(c«Lojia/ Ilyyiane. Willard S. Small. Bulletin No. 33, 1923. 

:iG pp. 

-Rducutional ProyreHs and the Parenta, Orville G. Brim Rural 
Scluiol LoiidcL No. 15, May, 1923. 8 pp. 

.Kdncafirj7ial iS'»nicf/s. Edward Franklin Buchner. Bulletin No. 

17, 1!>2,3, 44 pp. 

EducatumnI Work of The Knighta of Columbus. Mark J. Swenny. 
BullcLin No, 22, 1923. 12 pp. 

EdKcadoncU Work of the Young Women's CAristaon Association. 
By Education and Research Division, National Board of Y, 
\V. C. A. Bulletin No. 26, 1923. 24 pp, 

in Foreign fjttngiiagca. Science and Camtnercial Sicb- 
jerta in Public High Schools. Florence DuBois. Statistical 
Circular No. 2, May, 1923. 9 pp, 

Fi'darid Aid to Public Schools, Fletcher Harper Swift. Bulletin 
No, 47, 1922. 47 pp. 

Hampton Narinal aifd Agricultural Jnslitule. Walton C. John- 
Uulietiii No, 27, 1923. 116 pp. 

IIiglii:r Edncalimi, 1920-1922. George F. Zook. Bulletin No. 34, 
1923. 33 pp. 

Ilistorii of the Manuat Training School of Washington University. 
(St, Louis Training .School.) Charles Penney Coates. Bullo- 
tin No. 9, 1923. KG pp. 

Ilonw Eeonomirs IdducatioM. Henrietta TV. Caivin. Buiietin No. 
(5, 1923. 19 pp, 

Iowa Phi'll of Saperintendenta and Teachers for Consoli¬ 

dated SehoolH. Macy Campbell. Rural School Leaflet No. 17, 
Juno, 1923. 

.Junior High Schools of Berkeley, California. James T. Preston 
and oLlicrs, Bulletin No. 4, 1023. 48 pp. 

Main Streets of the Nation. A Series of Projects on Highway 
Ti'nnsport for Elementary Schools. Florence C. Fox. Bulletin 
No. 38, 1923, 42 pp. 

Medicai Eduraiion, 1^20-1922. N. P. Colwell, M. C. Bulletin No. 

18, 1923. 17 pp. 

Obfedives in Elementary Rural School Agrieultttre. E. E. Windes. 

Rural School Leaflet No. 11, March, 1923. 18 pp, 

• Organization and' Conduct of Businesa. Glen Levin Swiggett. 

Coiumercial Education Leaflet No. 6, June, 1923. 18 pp. 
Priiioip/r.s of Kindergarten-Pritnary Education in the Consolidated 
Rural School. Katherine M. Cook. Rural School Leaflet No. 
18, June, 192,3. 9 pp. 

Progres.iive Tcndeyieipa in European Education. C. W. Waahburne. 
Bulletin No. 37, 1923. 31 pp. 
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Public Education in Oklahoma. Bulletin No. U, 1D23. 92 pp. 
Public Scfiocl System of Arkansas. Bulletin No. 11, 1923. 110 pp. 

Recent Advances in Instruction in Music. Will Enrhart nnd 
Charles N. Boyd. Bulletin No. 30, 1923. 21 pp. 

Recent Developments in BdiicationalJournalism. W. Car.son Rynn, 
Jr. Bulletin No. 26, 1923. 14 pp. 

Record of Current Educational Publications. Bulletin No, 32, 1923. 
3G pp. 

References on Education of Women in the United States. Library 
Leaflet No. 10, April, 1923. 7 pp. 

References on Preschool and Kindergarten-Primaru i?f2jfcatio7i, 
Nina C, Vandewalker and Harriet E. Howard. Kinderffurten 
Circular No. 14, July, 1923. Price per copy 6 cents, 11 pp. 

Rural-Teacher Situation in the United States. Mabel Carney. 
Rural School Leaflet No. 14, May, 1923, Price jicr copy 6 
12 pp. 

School Building Program for Washington, North Carolina. Alice 
Barrows. Bulletin No. 2, 1923, 20 pp. 

School Support and School hidobledness in Cities, Florence Du- 
Bois, Statistical Circular No. 3, June, 1923. 6 pp. 

Social Studic-f in Civic Ed?teatio». Edgar Dawson. Bulletin No. 
23, 1923. IG pp. 

Some Industrial Art Schools of Europe. Mnriu.s Vachon. Trans¬ 
lation by Florence N. Levy. Bulletin No, 48, 1922. 69 pp. 
State Policie.s in Public School Finance. Fletcher Harper Swift. 
Bulletin No, 6, 1922. 64 pp. 

Statistical Survey of Education, 1019-1920, Florence DuBoi.’i. 
Bulletin No. 16, 1923. 41 pp. 

Statistics of City School Systems, 1919-1920. H, R, Bonner. Bul¬ 
letin No. 17, 1022. 173 pp. 

Statistics Relating to Bminaas Education in Colleges and Univer¬ 
sities, 1921-1922. Glen Levin SwiggetL, Commercial Educa¬ 
tion Leaflet No. 6, June, 1923. 8 pp. 

Swperviaioii of Ono-Teachei‘ Sekoole. Maud C. Newbury. Bulletin 
No. 9, 1923. 66 pp. 

Vocational Ed^lcation. William T. Bnwden. Bulletin No. 28, 1923. 

26 pp. 

Robinson, George Edwin. Scientific Salesmanship. Three Vol¬ 
umes. American College of Scientific Sulesninnship, Chicago, 

Skaggs, Ernest Burton, Elementary Text Book of Mental Meas- 
uremants. George Wahr, Publisher, Ann Arbor, Mich, 169 pp. 
Starch, Daniel. Principles of Advertising, A. W. Shaw Com¬ 
pany, New York. 998 pp. 

Wateb, George Frederick. The Afagie of Common Sense. E. P. 
Dutton & Company, New York. Prico ?1,60. 107 pp. 

Wood, Ben D. Measurement in Higher ^’<fKcat£oii. World Book 
Company, Yonkera-on-Hudson, N. Y. 337 pp. • 
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